-- Logs begin at Wed 2022-09-07 12:19:56 UTC, end at Wed 2022-09-07 13:22:57 UTC. -- Sep 07 12:51:05.780653 dv-cinder-856259-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 12:51:05.790575 dv-cinder-856259-1-smb devstack@keystone.service[81474]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:51:05 2022] *** Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: nodename: dv-cinder-856259-1-smb Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: machine: x86_64 Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: clock source: unix Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: pcre jit disabled Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: detected number of CPU cores: 4 Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: current working directory: / Sep 07 12:51:05.792740 dv-cinder-856259-1-smb devstack@keystone.service[81474]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: your processes number limit is 47680 Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: your memory page size is 4096 bytes Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: detected max file descriptor number: 2048 Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: lock engine: pthread robust mutexes Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: thunder lock: enabled Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 12:51:05.793391 dv-cinder-856259-1-smb devstack@keystone.service[81474]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:51:05.833367 dv-cinder-856259-1-smb devstack@keystone.service[81474]: Python main interpreter initialized at 0x562a1955e9c0 Sep 07 12:51:05.833367 dv-cinder-856259-1-smb devstack@keystone.service[81474]: python threads support enabled Sep 07 12:51:05.833367 dv-cinder-856259-1-smb devstack@keystone.service[81474]: your server socket listen backlog is limited to 100 connections Sep 07 12:51:05.833367 dv-cinder-856259-1-smb devstack@keystone.service[81474]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:51:05.833722 dv-cinder-856259-1-smb devstack@keystone.service[81474]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:51:05.833793 dv-cinder-856259-1-smb devstack@keystone.service[81474]: *** Operational MODE: preforking *** Sep 07 12:51:05.834038 dv-cinder-856259-1-smb devstack@keystone.service[81474]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:51:05.834038 dv-cinder-856259-1-smb devstack@keystone.service[81474]: spawned uWSGI master process (pid: 81474) Sep 07 12:51:05.834250 dv-cinder-856259-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 12:51:05.839486 dv-cinder-856259-1-smb devstack@keystone.service[81474]: spawned uWSGI worker 1 (pid: 81486, cores: 1) Sep 07 12:51:05.839486 dv-cinder-856259-1-smb devstack@keystone.service[81474]: spawned uWSGI worker 2 (pid: 81487, cores: 1) Sep 07 12:51:05.839486 dv-cinder-856259-1-smb devstack@keystone.service[81474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:51:10.163770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:51:10.163770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: from cryptography.utils import int_from_bytes Sep 07 12:51:10.164571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:51:10.164571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: from cryptography.utils import int_from_bytes Sep 07 12:51:10.164696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:51:10.164696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: from cryptography.utils import int_from_bytes Sep 07 12:51:10.165128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:51:10.165128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: from cryptography.utils import int_from_bytes Sep 07 12:51:10.214021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:51:10.214216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:51:10.214385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] command line args: [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:51:10.214648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:51:10.214823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ================================================================================ {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:51:10.214910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:51:10.215067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:51:10.215153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] admin_token = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.215260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] command line args: [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:51:10.215346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] config_dir = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.215499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.215597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:51:10.215672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] config_source = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.215748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ================================================================================ {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:51:10.215851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] debug = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.215961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] admin_token = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] config_dir = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] config_source = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] debug = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.216941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_config_append = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_dir = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.217971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_file = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_config_append = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_dir = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.218909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_file = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.219956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.220885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.221963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] publish_errors = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.222915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] publish_errors = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] standard_threads = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.223949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] use_journal = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] standard_threads = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] use_json = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] use_stderr = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] use_syslog = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.224996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] use_journal = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.225212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.225347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] use_json = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.225497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.225633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] use_stderr = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.225633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] use_syslog = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.225869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:51:10.226149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.226940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.227874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.228887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.229915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.230876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.231913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.232935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.233966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.234857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.235957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.236965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.237980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.238936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.239995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.240993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.241939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.242945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.243895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.244924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.245900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.246918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.247945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.248882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.external = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.249837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.250001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.250081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.250231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.password = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.250310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.250989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] auth.token = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.external = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.251968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.password = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] auth.token = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.252996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.253935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.254892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.255892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.256846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.257955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.258980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.259942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.260875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.261957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.262968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.263935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.264856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.265934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.266022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.266246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.266867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.267998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.268958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.269984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.270975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.271922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.272936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.273949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.274980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.275897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.276934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.277972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.278878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.279905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.280917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.281843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.282952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.283924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] role.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.284931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] role.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.285923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] role.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] role.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.286968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.287946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.288933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.289959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.290990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.291980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.292936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.293909 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.294895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.connection = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.295985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.connection = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.296999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.297142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.297221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.297425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.297953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.297953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.298979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:51:10.299533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.299771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.300014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.300245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.300483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.300719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:51:10.300890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:51:10.330044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.330266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.330490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.332830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.333068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.333296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.338815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.341538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.366507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.366729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.367834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.368065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.420105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.420670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.468610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.468835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.469690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.469921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.624843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.625123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.625286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.625427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.625643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.625852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.626082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.626280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.626280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.626531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.627278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.627436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.649376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.649608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.649706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.649842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.649928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.650925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.662021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.662266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.675698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.675866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.675954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.676931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.677016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.677204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81487) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:51:10.694368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.694569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:51:10.694714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.694906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.694997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:51:10.695103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:51:10.695246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.695373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.695490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:51:10.695658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.695743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.695917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.695998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.696170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.696252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.696472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.705717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.705988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.706818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.713513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.713794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.716416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.716698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.716779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.716979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.717878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.718947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.719125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.719208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.719419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.742278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.742659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.743828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.744109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.744194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.744420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.748756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.749039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.749134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.749316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.749401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.749617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.756291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.756573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.756658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.756859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.762206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.762501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.762582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.762787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.762871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.763993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.764175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.764259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.764439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.779634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.779912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.780013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.780266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.783811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.784130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.787010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.787301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.787399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.787621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.791563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.791783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.794719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.794849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.798695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.798894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.799911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.800157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.800250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.800523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.800820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.816734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.817021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.817272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.817356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.817532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.817614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.817808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.818069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.824561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.824950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.826107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.826469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.827658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.827933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.828016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.828286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.830680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.830962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.831245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.831972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.832271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.843187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.843405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.843538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.843709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.843795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.843983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.844066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.844338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.844479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.844769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.844918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.845069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.845155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.845419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.861105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.861474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.864062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.864396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.867050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.867541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.868515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.869023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.869984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.870266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.870473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.870655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.870737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.871137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.877853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.878041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.879314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.879506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.882323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.882424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.882711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.882799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.882997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.883080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.883275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.883367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.891070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.891199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.891483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.891632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.891777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.891925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.898565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.898845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.898929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81487) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:51:10.899124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.899964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.900994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.901938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.902115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.902196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.902377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81487) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:51:10.937641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a1955e9c0 pid: 81486 (default app) Sep 07 12:51:10.937853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a1955e9c0 pid: 81487 (default app) Sep 07 12:51:10.941324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e5e8-834f-4f7a-b7db-f1d70c000c10 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:10.941612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e5e8-834f-4f7a-b7db-f1d70c000c10 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:10.941880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48e5e8-834f-4f7a-b7db-f1d70c000c10 None None] PATH_INFO: `/v3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:10.946012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Sep 7 12:51:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:17.876942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:17.877479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:17.877479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:17.881753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:17.887062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:17.887608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:17.887608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:17.959161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: INFO dbcounter [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] Registered counter for database keystone Sep 07 12:51:17.978274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG oslo_db.sqlalchemy.engines [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:51:17.984546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writer thread running {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:51:18.172812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG passlib.handlers.bcrypt [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81486) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:51:18.173165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG passlib.handlers.bcrypt [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81486) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:51:18.231312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:18.232920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:18.364250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 12:51:18.805509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:18.875523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: INFO dbcounter [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] Registered counter for database keystone Sep 07 12:51:18.897257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG oslo_db.sqlalchemy.engines [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:51:18.903702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writer thread running {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:51:19.022171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49894f-bde9-49ee-ac17-76f0aeba4895 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:19.026425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:19.027075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:19.027386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:19.027718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:19.036762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:19.089707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:51:19.089983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3c014-73f0-4e10-bc79-08e5726616eb admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:19.100587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Sep 7 12:51:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 12:51:19.106960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:19.121961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449472cb-d933-426a-bd44-82139ee84dbf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:19.126678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:19.127820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:19.128108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:19.128382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] PATH_INFO: `/v3/projects/6357086c38f94b52a4634cd4a7e2bbea` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:19.130075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] RBAC: Authorizing `identity:get_project(project_id=6357086c38f94b52a4634cd4a7e2bbea)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:19.183382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:51:19.183743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918c1cd-e08f-4f50-9db9-25ca70f2d85f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:19.189130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Sep 7 12:51:19 2022] GET /identity/v3/projects/6357086c38f94b52a4634cd4a7e2bbea => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:21.330206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ec81-7363-4ab9-bf75-f539a317ecd0 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:21.330752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ec81-7363-4ab9-bf75-f539a317ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:21.330752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8ec81-7363-4ab9-bf75-f539a317ecd0 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:21.334871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:21.340436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:21.340860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:21.340997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:21.361725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:21.363262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:21.371277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 12:51:21.639021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8ec81-7363-4ab9-bf75-f539a317ecd0 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:21.651238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8ec81-7363-4ab9-bf75-f539a317ecd0 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:21.655454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:21.656072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:21.656350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:21.657172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:21.664754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:21.666499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11efe68-5308-4395-bb21-e34327111729 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:21.675932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Sep 7 12:51:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 12:51:21.681394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:21.690762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1150-806c-4251-aacc-df775281e3e9 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:21.695047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:21.695692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:21.695967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:21.696233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:21.697521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:21.699319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2c188-3649-40ec-b871-5f2e7745dc24 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:21.700853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Sep 7 12:51:21 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:23.924068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070328c-b7ba-4568-983f-d8430de6e554 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:23.924615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070328c-b7ba-4568-983f-d8430de6e554 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:23.924615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070328c-b7ba-4568-983f-d8430de6e554 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:23.925935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:23.931276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:23.931778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:23.931875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:23.950015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:23.951204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:23.993483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b232-e132-4b45-9c7a-6f230768a12d None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:23.993898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b232-e132-4b45-9c7a-6f230768a12d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:23.994181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671b232-e132-4b45-9c7a-6f230768a12d None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:23.995534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:24.001136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.001427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.001710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.033274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:24.044662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG passlib.handlers.bcrypt [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81487) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:51:24.045064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG passlib.handlers.bcrypt [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81487) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:51:24.095236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:24.096859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:24.198650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:24.303054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.329664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:24.409407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723069c-b7f8-4832-b06e-4ad829ad7bc2 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.442418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.443044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.443322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.443627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.455333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:24.464149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:24.465178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:24.466150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:24.473093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.475284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.560043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:24.577692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4381b96-9943-477e-ae17-6151dc2dcc5d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.580117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa678-9d94-44eb-b70c-7e482a9417b7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.580767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:24.615023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.615662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.615940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.616215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.616879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.617747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.618031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.618308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.619156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:24.619468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:24.620923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:24.633759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:24.639358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.686936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:24.689616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:24.740097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f687-cfdb-49e3-94dc-9733f363c92e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.771068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:24.775563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.776425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.776707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.776978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.778558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:24.780050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:24.781815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 9/16] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:24.787440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.790162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 8/17] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:24.795584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.822529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:24.888611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef875d92-3f4a-4cfb-9d19-61df3cfa9838 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.895364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a8876-9b1a-473a-a94a-967cc6bcf99c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:24.921467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.922615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.922924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.923190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.924334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:24.925747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:24.927291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:24.929067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:24.929699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:24.929979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:24.930254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:24.933013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:24.942025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:24.943521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:51:24.959290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:24.960190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:51:24.960968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:51:24.960968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:51:24.960968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:24.960968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:24.967159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:25.001586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:25.032065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924f965-2511-4304-b893-77901657d4f6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:25.033628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:25.067292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:25.067937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:25.068213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:25.068482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:25.069199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.domain.id=default, user.id=a3c66ed18b954814afb1ba80dd0f24ae) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:25.069502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:25.069587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee101d1-3bb2-4b16-968f-79e8a91e0976 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:25.071015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39577ee-7f15-40e5-809a-1a12469f3282 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:25.080272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/role_assignments?user.id=a3c66ed18b954814afb1ba80dd0f24ae&scope.domain.id=default&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:25.105514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:25.106141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:25.106420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:25.106692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:25.107353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:25.107683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:25.109139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbce625-3132-42ff-9a11-3a8036425c4a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:25.128790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:27.629502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f177-56d4-4ba5-9d07-f59956b800ea None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:27.630327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f177-56d4-4ba5-9d07-f59956b800ea None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:27.630798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f177-56d4-4ba5-9d07-f59956b800ea None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:27.632439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:27.637897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887742-2d8d-410a-8c2b-dfd88913461e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:27.638717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887742-2d8d-410a-8c2b-dfd88913461e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:27.639207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f887742-2d8d-410a-8c2b-dfd88913461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:27.665064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3f887742-2d8d-410a-8c2b-dfd88913461e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:27.666633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3f887742-2d8d-410a-8c2b-dfd88913461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:27.758773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:28.090725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d76-5e01-4c7c-9dba-99cbf9d72007 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.091402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d76-5e01-4c7c-9dba-99cbf9d72007 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.091969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d76-5e01-4c7c-9dba-99cbf9d72007 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.093504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:28.099199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956648a-11ca-45f9-b924-442e39df9bca None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.099758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956648a-11ca-45f9-b924-442e39df9bca None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.100279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956648a-11ca-45f9-b924-442e39df9bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.126651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d956648a-11ca-45f9-b924-442e39df9bca None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:28.128246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d956648a-11ca-45f9-b924-442e39df9bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:28.151121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:28.180524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a977-ed26-4886-8043-8233d8ef2e70 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.180817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a977-ed26-4886-8043-8233d8ef2e70 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.181078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091a977-ed26-4886-8043-8233d8ef2e70 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.182409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 14/25] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:28.183574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2b20-6652-4252-a4b4-94db322efb6e None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.183911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2b20-6652-4252-a4b4-94db322efb6e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.184194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2b20-6652-4252-a4b4-94db322efb6e None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.185375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:28.188843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.189164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.189385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.225695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:28.226913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:28.247617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 12/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:28.249404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.249945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.250952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.287677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:28.290921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:28.374217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:28.375251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:28.432336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 13/29] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:28.507302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:28.513728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d88d44-bc36-4fad-8511-9c793bcc0d2b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:28.548316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:28.551531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:28.552177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.552481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.553605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.578727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:28.580998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:51:28.602924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:28.604078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:51:28.604893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:51:28.604893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:51:28.604893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:28.606718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 17/30] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:28.616278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:28.648629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:28.682839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d741858-a05b-438e-940b-6d7b47d8b12c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:28.749706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:28.754731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.755262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.755751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.784841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:28.791683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:28.793427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:28.794704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 14/31] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:28.809797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:28.812067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc54e4d-9ca0-4f87-99f9-f58b94a6bfab None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:28.883772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:28.885315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:28.885947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:28.887852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:28.888544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:28.888861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:28.890269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:28.910361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:28.911136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:28.931822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:28.971990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46393791-a375-40a9-920f-a05c17fff426 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.015713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.017217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.018174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.018761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.019453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:29.019797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.021742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.038417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 15/33] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:29.039815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:29.046319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65b57b-7771-484b-a230-f05dbb90947d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.055428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:29.087097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.087858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.088211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.088585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.089375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.091449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.179688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84046bb-61b9-4639-99f4-903f9ab4da8c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.222828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.224135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.224668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.225127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.226021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.227901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c72fef-4568-4546-9df6-cbb70da941bf None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.247309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 19/34] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Sep 7 12:51:28 2022] POST /identity/v3/roles => generated 225 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:29.248552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:29.331881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:29.366982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c7c7d-17ee-421f-93e1-d9bd11d7aae6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.412253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.413081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.413433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.413783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.414540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.416347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.454286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 20/35] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:51:29 2022] POST /identity/v3/projects => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:29.455062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:29.490406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 16/36] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Sep 7 12:51:29 2022] POST /identity/v3/roles => generated 219 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:29.492458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a49-b241-450e-a0ad-b7de648bd20e None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.492994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a49-b241-450e-a0ad-b7de648bd20e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.493522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c825a49-b241-450e-a0ad-b7de648bd20e None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.495164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 17/37] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:29.503346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e38e-8b94-440e-8e55-240343e35851 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.504052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e38e-8b94-440e-8e55-240343e35851 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.504545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e38e-8b94-440e-8e55-240343e35851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.560680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0f77e38e-8b94-440e-8e55-240343e35851 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:29.563595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0f77e38e-8b94-440e-8e55-240343e35851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:29.614982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97014d-c44e-4b17-afff-d42175c08117 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.667889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:29.692228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.693072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.693370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.699498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.699498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.699498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.700161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 21/38] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:29 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:29.707871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:29.709109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:29.725697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 18/39] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:29.757258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5da68-0b4c-4b20-9316-0d1f8ea98c67 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.757541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5da68-0b4c-4b20-9316-0d1f8ea98c67 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.757812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5da68-0b4c-4b20-9316-0d1f8ea98c67 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.759309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 19/40] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:29.764615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.764897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.765170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.792362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:29.793570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:29.839799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cedeaf-739d-47c6-b090-1ea20e91468d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:29.882939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:29.883636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:29.883923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:29.884203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:29.886121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:29.887683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:29.888994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:29.892017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 22/42] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:29.898138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:30.001337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928925-4c38-4efc-95c2-d97e6acc527a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:30.027032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:30.036776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:30.037463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:30.037743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:30.038018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] PATH_INFO: `/v3/domains/default/users/a3c66ed18b954814afb1ba80dd0f24ae/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:30.040131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a3c66ed18b954814afb1ba80dd0f24ae, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:30.040522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:30.041730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:30.058099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Sep 7 12:51:29 2022] PUT /identity/v3/domains/default/users/a3c66ed18b954814afb1ba80dd0f24ae/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:51:30.108145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:30.159548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08935d-0f3f-4dae-b386-8209618f311b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:30.159854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:30.200522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:30.201172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:30.201448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:30.201718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:30.204710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:30.206194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:30.208154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:30.213837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:30.291379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981f3c2-f847-49ee-807c-af98ca62fa16 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:30.336963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:30.337591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:30.337875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:30.338209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:30.338915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:30.340404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac429d-801a-47b8-b559-5c06de28e306 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:30.346809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d887f3-ec65-47f8-8f52-5c37a36da02d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:30.359444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Sep 7 12:51:30 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:51:30.380053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:30.396789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:30.397426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:30.397710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:30.398001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:30.398687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:30.400208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e6f12-85b4-4b07-9c50-5542d524ff34 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:30.440919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:51:30 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:51:32.300730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e5519-20c5-4371-b6aa-c5ae4e2ca265 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.301244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e5519-20c5-4371-b6aa-c5ae4e2ca265 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.301326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e5519-20c5-4371-b6aa-c5ae4e2ca265 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.302610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:32.307881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.308287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.308424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.327493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:32.328979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:32.395178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:32.665639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d690-8e03-42b7-840e-5a7f3ef5491f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.665940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d690-8e03-42b7-840e-5a7f3ef5491f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.666174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:32.666267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d690-8e03-42b7-840e-5a7f3ef5491f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.667590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 24/49] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:32.673226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.673506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.673783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.691488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:32.692705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:32.735524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:32.763269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 25/50] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:32.767006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d47684-78b3-4ccd-bfe5-6172ec7e1c11 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:32.774358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:32.804884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:32.805508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.805824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.806174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.817388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:32.823915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:32.824778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:32.825504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:32.830787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:32.928076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f908c-6951-4b4e-b8cd-bc8eca88d57b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:32.960360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:32.960954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:32.961231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:32.961507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:32.962159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:32.962461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:32.963874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:32.972521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:32.978248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:33.033067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:33.073902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.081064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836daa-7e52-4679-9a78-e44ab1496576 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:33.116604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:33.117235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:33.117514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:33.117792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:33.118923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:33.120393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:33.122154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:32 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:33.127599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:33.135677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f593d0-e7f5-48d0-90b9-734458a30949 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:33.173542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:33.174196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:33.174476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:33.174750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:33.175952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:33.177453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:33.179184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:33.184880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:33.267234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.289358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f42ed-0ec6-41b9-af7d-01b7f3064041 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:33.296289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:33.325660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:33.326300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:33.326537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:33.326808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:33.327481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:33.329060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:33.335502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfdec7-e210-419b-9b60-c6be02866e1c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:33.356799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 28/55] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Sep 7 12:51:33 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:51:33.378962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:33.379773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:33.380059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:33.380334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:33.381533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:33.383019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5ce2d-4cab-48be-b93f-fa56ad61258e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:33.384714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:33.390970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:33.502339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf61e-4697-4978-b189-0fd4a69464bd None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:33.549125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:33.549736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:33.550021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:33.550292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:33.551016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.domain.id=default, user.id=a3c66ed18b954814afb1ba80dd0f24ae) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:33.551324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:33.552846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6308eb-562c-4de5-a0c1-2ea881661cbe None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:33.560044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Sep 7 12:51:33 2022] GET /identity/v3/role_assignments?user.id=a3c66ed18b954814afb1ba80dd0f24ae&scope.domain.id=default&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:35.549871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936475-2418-41b7-ac6e-b4b9069faab3 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:35.550352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936475-2418-41b7-ac6e-b4b9069faab3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:35.550434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936475-2418-41b7-ac6e-b4b9069faab3 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:35.551802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:35.557019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:35.557420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:35.557580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:35.575913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:35.577129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:35.594227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:35.649005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:35.914586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936475-2418-41b7-ac6e-b4b9069faab3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:36.013505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936475-2418-41b7-ac6e-b4b9069faab3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:36.014991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:36.049039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:36.049663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:36.049946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:36.050219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:36.051334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:36.052878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3148-70c4-4b89-947c-008bf4fb0e3e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:36.054477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:36.060040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:36.157507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf610a9c-dd0d-469b-accf-b13b92139cfb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:36.192213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:36.192745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:36.193025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:36.193293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:36.193941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:36.195373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b48a-862c-4b1b-abac-68b1c0c11775 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:36.221136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:51:36 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:39.567366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e24-6155-4c5c-a529-f04759332f8a None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:39.567969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e24-6155-4c5c-a529-f04759332f8a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:39.568408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e24-6155-4c5c-a529-f04759332f8a None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:39.571275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:39.580620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f337c-4cc2-444d-b744-af389382221a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:39.581192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f337c-4cc2-444d-b744-af389382221a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:39.581632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f337c-4cc2-444d-b744-af389382221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:39.621158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4f3f337c-4cc2-444d-b744-af389382221a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:39.623090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4f3f337c-4cc2-444d-b744-af389382221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:39.629172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:39.776317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:39.943691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b50e-03bf-440d-b0b7-2637ee645b55 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:39.944179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b50e-03bf-440d-b0b7-2637ee645b55 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:39.944662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b50e-03bf-440d-b0b7-2637ee645b55 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:39.947636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:39.954072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32d2fd-0221-4a75-86d6-9e0a843deb2e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:39.954626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32d2fd-0221-4a75-86d6-9e0a843deb2e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:39.955115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32d2fd-0221-4a75-86d6-9e0a843deb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:39.992587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f6f6-406d-4b74-9a8d-c668f62b8cb7 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:39.993088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f6f6-406d-4b74-9a8d-c668f62b8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:39.993569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004f6f6-406d-4b74-9a8d-c668f62b8cb7 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:39.996136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 33/65] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:40.001713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fe32d2fd-0221-4a75-86d6-9e0a843deb2e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:40.005627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713871-fea7-4122-8a04-fbcbdf7ba669 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.006114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713871-fea7-4122-8a04-fbcbdf7ba669 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.006595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713871-fea7-4122-8a04-fbcbdf7ba669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.011435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fe32d2fd-0221-4a75-86d6-9e0a843deb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:40.062375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-99713871-fea7-4122-8a04-fbcbdf7ba669 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:40.065951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-99713871-fea7-4122-8a04-fbcbdf7ba669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:40.123881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:40.125216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c978bf-287f-4657-8dbb-ca2444586bea None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.125510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c978bf-287f-4657-8dbb-ca2444586bea None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.125788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c978bf-287f-4657-8dbb-ca2444586bea None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.127726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 34/67] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:40.128608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c978bf-287f-4657-8dbb-ca2444586bea None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.155116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:40.157875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.158493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.159044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.182269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:40.184502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:40.209028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.269250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c978bf-287f-4657-8dbb-ca2444586bea None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.314960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:40.334583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.335221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.335517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.335795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.352848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:40.357780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:40.358653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:40.359400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 35/70] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:40.366214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.408378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.460233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.509760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1607-6388-47e8-96ad-71af5a792c0a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.559272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.560832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.561258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.561695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.562495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:40.563212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:40.566384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:40.577909 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189fe7a-be8f-4159-a389-d3f20d3cd740 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.578099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:40.578811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.611297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.621193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.622292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.623252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.623792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.636991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:40.642714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:40.643800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:40.649540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.701534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.712319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42695965-7df1-4fb1-b1d6-e6ddf7b6b8e0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.750233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.750893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.751206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.751505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.753622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13bbe7-51ed-4d2b-9b92-ac56684b0f24 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.762280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:40.768191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:40.769113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:40.769861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:40.770474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.790839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.791485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.791773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.792044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.805375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:40.807034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:40.808686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:40.809443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.855514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.877319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b0139-3693-4f22-ae2f-56a0fa82d186 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.909357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85da00-dfc3-46f0-bec7-ce1c28c5c646 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:40.910989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a8628-4429-416f-9829-034627f58574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.911667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8628-4429-416f-9829-034627f58574 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.911949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8628-4429-416f-9829-034627f58574 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.912232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a8628-4429-416f-9829-034627f58574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.913364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8628-4429-416f-9829-034627f58574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:40.914793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a8628-4429-416f-9829-034627f58574 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:40.916402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:40.917515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969a5b2-a94d-4935-9c40-2e63d2abe392 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.917799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969a5b2-a94d-4935-9c40-2e63d2abe392 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.918075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969a5b2-a94d-4935-9c40-2e63d2abe392 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.923338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 39/76] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:40.923338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969a5b2-a94d-4935-9c40-2e63d2abe392 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:40.942903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:40.948982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:40.949604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:40.949884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:40.950150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:40.950821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:40.951129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:40.952563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:40.961385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:40.962190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.026912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969a5b2-a94d-4935-9c40-2e63d2abe392 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.060534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396790a-9937-4b26-9cb5-46c2b2bd9988 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.061913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.062519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.063066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.063335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.064173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:41.064528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.065886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.069551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.074395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:41.075181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.094473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.095647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.095922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.096188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.156737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.162832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.164338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.175396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d54f71-1cb6-4208-be71-25d248171abb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.211488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.212088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.212371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.212645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.213301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.214746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5266-e2cf-4254-8dbb-ecb3c8a527e3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.251780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 41/79] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:51:41 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:41.253294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.253789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.254168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.276670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:41.277655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 39/80] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:41.277943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:41.278481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.291039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.371436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 42/81] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:41.376695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.417896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedaf33-4757-4691-bfde-579d30dce5a7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.494033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.494623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.494798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.494927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.495201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.497003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.498927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.500915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 40/82] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:41 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:41.502713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.546491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d9a9-88c3-4726-a25a-34d0b4ed333e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.593120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.594590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.595041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.595367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.596644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.598150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.600077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 43/83] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:41 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:41.600898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.645073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.680984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4426e7e-1780-4941-bdc9-4420fb2e809d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.737067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.737784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.738074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.738355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.741699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.743862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.748018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:41 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:41.749886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:41.761367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510162f-bac8-4bbc-89b2-411d77a14fd6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.813404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.814563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.815017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.816568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.825975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:41.899026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96569b73-593a-4162-90e6-47dcd038ea82 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:41.922449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:41.924758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:41.948617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:41.949168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:41.949449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:41.949724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:41.969669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.044508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.046000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.054701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 44/85] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.055844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.099975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.178525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 42/86] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:42.179398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dedde-be3e-462c-b20d-5a624969d9ab None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.179834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.223372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.224354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.224781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.225198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.226106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:42.226621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.228499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.236658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=d56a4f333035431eb58b79b9117ac64d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:42.238447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.239941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.381935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936766b-c0b7-43e1-9cdc-b354939e47fe None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.395867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.399094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1dbd2-23ee-49a6-8d71-620f8a9677be None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.474725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.475306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.475636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.476317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.486128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.486668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.487139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.491490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:42.492405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.494080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:42.494792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:42.499929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 43/88] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:42.500693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.504142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 46/89] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:42.505468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.618769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deabee1-24be-415f-bd3c-e37712b3f1f9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.627837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.660536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.662324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.662744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.663274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.664765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.666519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.668337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 44/90] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:42.669235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.769711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77847fe-74b2-451d-8356-48bb1b7aeceb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.791644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87812217-58fc-4913-a7ae-bc1f5cb9feb6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:42.833389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.834590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.835329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.835798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.837057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a3c66ed18b954814afb1ba80dd0f24ae) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:42.837583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.839647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.845927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/role_assignments?user.id=a3c66ed18b954814afb1ba80dd0f24ae&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:42.846103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:42.846675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:42.846962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:42.847233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:42.847521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.847933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:42.848237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:42.849595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:42.886870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:42.893526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:42.910027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:42.991889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:43.004457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8434202-787f-4f7c-a5ad-f6e38add06d3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:43.066659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:43.068052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:43.068556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:43.069046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:43.070212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:43.070737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:43.072957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:43.082952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:43.163057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9d222-ed74-4678-96df-1dac87632c1e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:43.203158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:43.204138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:43.205100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:43.205582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:43.211593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:43.213283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:43.215146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:42 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:43.221778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:43.353265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:43.363706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f475e-8ecb-4984-a2a1-3ce9624bd91c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:43.413331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:43.413967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:43.414249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:43.414524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:43.496556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:43.498044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:43.607590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 47/95] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:43.609312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:43.613297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:43.748523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:43.752862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a8843-0846-4eb8-940f-4542d65df9e5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:43.802033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:43.802671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:43.802948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:43.803227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] PATH_INFO: `/v3/projects/b675e3cebf08410291b99a695a50f2a9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:43.804419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] RBAC: Authorizing `identity:get_project(project_id=b675e3cebf08410291b99a695a50f2a9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:43.805862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49813211-1a98-4efe-b7f6-3ee022d38fed None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:43.807539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:43 2022] GET /identity/v3/projects/b675e3cebf08410291b99a695a50f2a9 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:43.813767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:43.949779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445879fc-835a-4c91-944f-a9f51f6bf13b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:43.993328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:43.993950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:43.994228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:43.994499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:43.995219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=b675e3cebf08410291b99a695a50f2a9, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:43.995542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:43.996984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf90a4-15b2-4d56-ada0-6ecbfe2b094a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:44.002591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:43 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=b675e3cebf08410291b99a695a50f2a9&role.id=d56a4f333035431eb58b79b9117ac64d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:44.492557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11278-439e-4234-94fb-f615ebb7152c None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:44.492988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11278-439e-4234-94fb-f615ebb7152c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:44.493161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff11278-439e-4234-94fb-f615ebb7152c None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:44.494509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:44.509310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:44.509610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:44.509876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:44.541792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:44.543001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:44.616538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f29338-27f0-4277-86b5-f85359cacea1 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:44.616876 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f29338-27f0-4277-86b5-f85359cacea1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:44.617093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f29338-27f0-4277-86b5-f85359cacea1 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:44.618445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 51/99] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:44.624038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:44.624318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:44.624588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:44.632045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:44.644067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:44.646015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:44.647216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:44.754512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 52/101] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:45.031170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.082459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.193649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30b37f-5aba-4f4e-a8e9-93695c1d5b41 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.199337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:45.209887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318744e-342c-4b98-a2d7-b60e9c2bd297 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.230237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.230877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.231156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.231428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.232554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:45.233989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188514a1-240a-4f02-94da-a8fdc7a7f32a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:45.235774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:45.236872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad271d-45df-4eb7-8664-2803abd6dfe9 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.237152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad271d-45df-4eb7-8664-2803abd6dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.237418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad271d-45df-4eb7-8664-2803abd6dfe9 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.238604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 51/103] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:45.243850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad271d-45df-4eb7-8664-2803abd6dfe9 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.258704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.259344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.259899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.260179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.274407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a31a7742-2298-4f3d-a6f7-73f284f2c2d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:45.279337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:45.280222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:45.281546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 53/104] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:45.282218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.282218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.282871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.301753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:45.302993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:45.312992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:45.354894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad271d-45df-4eb7-8664-2803abd6dfe9 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.379614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 54/105] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:45.380658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.397638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.398251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.398531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.398802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.399473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:45.409267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:45.472060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 52/106] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:51:45 2022] POST /identity/v3/projects => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:51:45.501745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:45.538248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02284998-5cd2-40fe-87ae-9d844b369c92 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.578029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476743c-4232-42b7-962f-966630dde34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.578646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476743c-4232-42b7-962f-966630dde34c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.578933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476743c-4232-42b7-962f-966630dde34c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.579370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476743c-4232-42b7-962f-966630dde34c None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.580262 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476743c-4232-42b7-962f-966630dde34c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:45.580622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476743c-4232-42b7-962f-966630dde34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:45.582013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476743c-4232-42b7-962f-966630dde34c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:45.598544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 55/107] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:45.605133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.762819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80df920-4c9a-49fa-9b27-5afc0bfbc26d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.783143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:45.791358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476743c-4232-42b7-962f-966630dde34c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.810158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.810797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.811180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.811405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] PATH_INFO: `/v3/users/7c7ff5e350e04859956e5127dd04574f` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.833354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7ff5e350e04859956e5127dd04574f)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:45.834924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:45.839494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 53/108] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/users/7c7ff5e350e04859956e5127dd04574f => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:45.859032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.913421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476743c-4232-42b7-962f-966630dde34c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:45.951409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:45.952528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:45.953007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:45.953520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:45.965167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:45.971390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:45.972300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:45.973058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:45.975293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 56/109] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:45.981640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:45.994609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.013679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf546fa5-5001-46a1-96ce-1288e109fc02 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.052856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.053446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.053653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.053806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.099380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.102318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0167722-e202-42e4-8bab-6f53889e15d9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.130779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.130779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.164344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.165477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.165991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.166456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.167319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:46.167860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.169437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.183166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 57/110] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:46.190049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:46.236445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:46.248531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:46.331970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.375116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.379269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70158-b82a-48e8-83e4-2fd719ad2dbd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.416141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c35136-07d2-4cb9-be28-744307fadf7b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.418943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.419907 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.420404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.420881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.422234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.424064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c396d-852c-45cb-b95e-883a429d9b15 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.426064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 58/112] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:46 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:46.432265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17b88d-033b-4bb0-af04-937ddb919e1c None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.432778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17b88d-033b-4bb0-af04-937ddb919e1c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.433284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17b88d-033b-4bb0-af04-937ddb919e1c None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.434842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 59/113] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:46.436366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17b88d-033b-4bb0-af04-937ddb919e1c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:46.459433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.460522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.460999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.461476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.462810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.465235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664294ec-dc16-495d-ad45-d06c5f9c9fa1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.468089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 55/114] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:46 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:46.469560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.471883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.472374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.496983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:46.498596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:46.600632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17b88d-033b-4bb0-af04-937ddb919e1c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.615793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 56/115] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:46.617120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:46.701991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.703133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.704943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.705648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.708172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.711074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.712440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.724963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 60/116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:46 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:46.729177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:46.740376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:46.781635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6327f-1f19-4956-ada4-9f0388664ecd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.857418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:46.858531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.859009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.860337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.861441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=7c7ff5e350e04859956e5127dd04574f) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:46.864295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:46.867949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec66be-4b3c-4a97-89ff-e974cdff312b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:46.886807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 57/117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:46 2022] GET /identity/v3/role_assignments?user.id=7c7ff5e350e04859956e5127dd04574f&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=e5723533747d4566b5e168d4b16e0567 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:46.946826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ea79-41cc-428f-8d99-31d981280621 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:46.977658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82917-84a2-4926-a6d4-0362b0ffb3c9 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.978301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82917-84a2-4926-a6d4-0362b0ffb3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.978780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc82917-84a2-4926-a6d4-0362b0ffb3c9 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:46.980345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 58/118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:46.986245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:46.986772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:46.987241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.003174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:47.003870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:47.004146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:47.004417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a2a1a361ba2441d093ccdff3013d4adb/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.010109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, user_id=a2a1a361ba2441d093ccdff3013d4adb, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:47.010376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:47.020370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:47.022055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:47.044046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 61/119] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:51:46 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a2a1a361ba2441d093ccdff3013d4adb/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:51:47.044046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:47.166043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 59/120] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:47.193947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:47.243074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5afb9-cd1d-4f59-9246-02f3c9186107 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:47.292796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:47.293840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:47.294397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:47.294861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.307211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:47.313337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:47.314825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:47.315600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:47.317825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:47.323890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:47.398931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:47.443438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca7fa1-fade-46f0-957c-853904c2497d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:47.478686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:47.479304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:47.479613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:47.479888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.480644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:47.480947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:47.482329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:47.492560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:47.499372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:47.616816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4b7d0-5321-4e20-a945-58fdd1627bee None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:47.647845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:47.661034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:47.661709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:47.661994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:47.662271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.668221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:47.669747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:47.671860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:47 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:47.677700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:47.814749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb16030-c782-42ae-a2e3-955ba0b812a9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:47.844423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:47.854042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:47.855025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:47.855668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:47.856345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:47.858115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:47.859318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:47.861556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:47.863302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:47 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:47.869209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:48.035677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524774-7507-47cd-aff8-188eb20c7bb5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.046792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0cbe-a6f1-43ab-9338-b96080b19927 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.071457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.072043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.072327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.072599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.083614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b63c4a43-7012-4960-9798-aa2daa939615 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:48.089080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:48.089922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:48.090701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:51:48.091887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d779e-8c21-4257-b1ff-de9df58c02b1 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.091997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d779e-8c21-4257-b1ff-de9df58c02b1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.092258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d779e-8c21-4257-b1ff-de9df58c02b1 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.093506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 65/126] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:48.097146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d779e-8c21-4257-b1ff-de9df58c02b1 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:48.145028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.145876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.146378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.146985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a3c66ed18b954814afb1ba80dd0f24ae/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.152842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, user_id=a3c66ed18b954814afb1ba80dd0f24ae, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:48.154543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56158362-eae4-4fa1-b942-c14e7e0f6e60 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:48.168080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:48.200836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 62/127] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:51:47 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a3c66ed18b954814afb1ba80dd0f24ae/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:51:48.202095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.202382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.202658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.229392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d779e-8c21-4257-b1ff-de9df58c02b1 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.236370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:48.237648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:48.295599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.296599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.297105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.297572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.299314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:48.299922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:48.302062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:48.323731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 66/128] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:51:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:48.329770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:48.395549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:48.473212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 63/129] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:48.527758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a3ef8-5ea6-4964-b0b3-744c06941165 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.559829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:48.577336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.577914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.578193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.578464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.579787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:48.581290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:48.583016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 67/130] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:48 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:48.589517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:48.716656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee84f4c-e8e4-46a0-9eee-46c980cbb788 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.760084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.761060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.761529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.761994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.763323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:48.765000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:48.767355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 64/131] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:48 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:48.773219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:48.906383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd378b-58c2-4e23-94b2-552cf9ae894a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:48.946951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:48.947647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:48.947937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:48.948213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a2a1a361ba2441d093ccdff3013d4adb/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:48.950407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, user_id=a2a1a361ba2441d093ccdff3013d4adb, role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:48.951878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:48.970973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 68/132] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:51:48 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/users/a2a1a361ba2441d093ccdff3013d4adb/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:51:48.992196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:49.070547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:49.140829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474790-3906-4d0d-958e-95f77251a415 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:49.193001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:49.194007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.194504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.194969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.212595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-7f27b22d-8d9c-446a-a3ea-67f48d95d066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:49.218360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:49.219269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:49.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:49.222970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 65/133] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:49.230631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:49.251398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4809f4-1396-48fc-a46c-0f7f5fc11155 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.252045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4809f4-1396-48fc-a46c-0f7f5fc11155 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.252512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4809f4-1396-48fc-a46c-0f7f5fc11155 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.254034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 66/134] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:49.259643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.260246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.260718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.292110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:49.293667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:49.316104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:49.402676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24677bc-427c-435b-8908-226b75f157f4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:49.421094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:49.455260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:49.455828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.456166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.456443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.457117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:49.457437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:49.458807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:49.468227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 69/136] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:49.474211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:49.540266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:49.614731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dbdcf-9cf0-472c-bf1d-3ef9b99bf3b6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:49.655258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:49.656791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.656791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.656791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.660262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:49.661753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:49.663767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 68/137] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:49 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:49.668936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:49.814415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d8b4-95c2-48ad-a485-9b2cdce1c0a0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:49.822244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:49.851311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:49.852366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:49.852864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:49.853439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] PATH_INFO: `/v3/projects/b675e3cebf08410291b99a695a50f2a9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:49.854794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] RBAC: Authorizing `identity:get_project(project_id=b675e3cebf08410291b99a695a50f2a9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:49.856488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:49.858403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 70/138] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:49 2022] GET /identity/v3/projects/b675e3cebf08410291b99a695a50f2a9 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:49.864325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:49.984975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f960-dd2d-4d97-aad3-a80839aa4edf None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:49.996881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:50.001820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:50.044947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:50.045684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.045973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.046246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] PATH_INFO: `/v3/projects/b675e3cebf08410291b99a695a50f2a9/users/a2a1a361ba2441d093ccdff3013d4adb/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.051485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] RBAC: Authorizing `identity:create_grant(project_id=b675e3cebf08410291b99a695a50f2a9, user_id=a2a1a361ba2441d093ccdff3013d4adb, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:50.051485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b821c-0665-4cee-ae39-93c1aecda814 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:50.084273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:51:49 2022] PUT /identity/v3/projects/b675e3cebf08410291b99a695a50f2a9/users/a2a1a361ba2441d093ccdff3013d4adb/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:51:50.085773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f808f-27ff-465c-afcb-96e08f5fe1c0 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.087237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f808f-27ff-465c-afcb-96e08f5fe1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.087365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f808f-27ff-465c-afcb-96e08f5fe1c0 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.091505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 70/140] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:50.101380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.101686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.101935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.130899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:50.130899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:50.206480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 71/141] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:50.257898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f3626-4e99-47b8-af7f-1d215dc02ddb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:50.311236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:50.312270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.313023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.313699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.316314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:50.318059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:50.319989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 71/142] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:50.325561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:50.478192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:50.481381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929560e-2aae-41c4-bf00-b9e898c37b97 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:50.521922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:50.522430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.522702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.522966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.527500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:50.527500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74ce0f-2acb-4765-a0af-04c042d945db None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:50.557971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 72/143] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:51:50 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:50.626937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:50.694127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:50.771575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa2e0c-f00c-486c-9f3e-c51abd86d0f5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:50.774174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52ce91-90b3-453c-aa9c-fa1c4daa438b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.774456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52ce91-90b3-453c-aa9c-fa1c4daa438b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.774726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52ce91-90b3-453c-aa9c-fa1c4daa438b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.776300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 73/144] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:50.785899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.786189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.786439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.824160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:50.825391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:50.874683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:50.875438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:50.875769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:50.876055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:50.891483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:50.897856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:50.898705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:50.899451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:50.905294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:50.971400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 74/146] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 07 12:51:51.053567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928e31c-38d1-41d0-9c02-a9926387d0e1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.055095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:51.101334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.102036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.102311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.102581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.103248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:51.103573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:51.104953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:51.116595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 73/147] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:51.122516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:51.223950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:51.245719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2737bd-c0ab-4f42-8a00-52a0008e9d1a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.287009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:51.288925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.289571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.289846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.290116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] PATH_INFO: `/v3/users/7c7ff5e350e04859956e5127dd04574f` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.291265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] RBAC: Authorizing `identity:get_user(user_id=7c7ff5e350e04859956e5127dd04574f)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:51.292818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:51.294533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 75/148] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:51 2022] GET /identity/v3/users/7c7ff5e350e04859956e5127dd04574f => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:51.300538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:51.432438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be96f3e-4a70-40a3-80f3-1d1f44e27952 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.439755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28776-63de-4329-9666-f0446006a4bc None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.484478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.485147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.485976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.486241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.487253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.487921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.488200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.488475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.490713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:51.492233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56ff6-3adf-4566-b492-6f9941a014a2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:51.494425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 76/149] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:51 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:51.495609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38288b-d36d-4740-9d07-7f47db23fbab None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.495890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38288b-d36d-4740-9d07-7f47db23fbab None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.496163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38288b-d36d-4740-9d07-7f47db23fbab None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.498872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 77/150] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:51.502025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:51.504125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.504410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.504687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:51.507416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:51.508277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 74/151] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:51.509693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:51.529228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:51.530696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:51.554501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:51.559581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:51.671205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807068c-e1cc-4e28-bad1-1234bd057a5b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.701953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 78/152] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:51.705613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:51.800210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.800891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.801169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.801508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/users/7c7ff5e350e04859956e5127dd04574f/roles/e5723533747d4566b5e168d4b16e0567` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.812336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, user_id=7c7ff5e350e04859956e5127dd04574f, role_id=e5723533747d4566b5e168d4b16e0567)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:51.814226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:51.852989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfb6a-789d-4051-85a6-d9a4c0a92628 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:51.854196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 75/153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:51:51 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/users/7c7ff5e350e04859956e5127dd04574f/roles/e5723533747d4566b5e168d4b16e0567 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:51:51.893024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:51.893695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:51.893975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:51.894242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:51.894925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:51.895225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:51.896738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:51.905931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 79/154] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:51.912869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.072392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.093005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0751-52b4-4f54-a0d9-65c9798e8ec3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.135370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.136040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.136366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.136647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.137817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.139321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.141141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 76/155] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:51 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:52.148150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.176050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.221998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.281066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c567-d8c6-44ac-a7fc-2002914988c3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.336290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.336841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.337121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.337397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.352474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea7e8d-6ce4-4d0e-a9a3-ea33c1fa5c0e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.392988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.394010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.394511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.394987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.407609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:52.413772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:52.414808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:52.415677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:52.418486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 77/156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:52.425148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.426499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.428091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d58b6-4bde-4537-82d1-ef877a4faf69 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.444176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.446619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.532821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 80/157] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:52.534425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c57-98da-48fd-bd53-bad0e1e3dca4 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.534714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c57-98da-48fd-bd53-bad0e1e3dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.534964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c57-98da-48fd-bd53-bad0e1e3dca4 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.536255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 81/158] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:52.538330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797c57-98da-48fd-bd53-bad0e1e3dca4 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.550085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53995f-ccd7-44e1-8c56-69b57cde0fb2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.590420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.591378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.591916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.592493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.593491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:52.594015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.596401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdf9e4-35fd-4c14-811e-c560a1a5250b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.606728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 78/159] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:52.612627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.613189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.613695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.634385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:52.636151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:52.648149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797c57-98da-48fd-bd53-bad0e1e3dca4 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.663618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.685366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.686025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.686301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.686570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.688001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.689508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.691546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 82/160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:52.692468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.717699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 79/161] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:52.718977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.723733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.801266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f69ba-8050-4534-a9f6-b0cff7952aae None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.834128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6fdb4-5e6f-4af9-b51b-1b9630444a85 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:52.838781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.839420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.839728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.840002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] PATH_INFO: `/v3/users/a3c66ed18b954814afb1ba80dd0f24ae` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.841196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c66ed18b954814afb1ba80dd0f24ae)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.842588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.845233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 83/162] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/users/a3c66ed18b954814afb1ba80dd0f24ae => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:52.865067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:52.882384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:52.883440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:52.883902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:52.884321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:52.885231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:52.885688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:52.887634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:52.895110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 80/163] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=d56a4f333035431eb58b79b9117ac64d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:52.929463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:52.989199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88ee27-5df0-492f-be1a-82bc23997753 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:53.025733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:53.026739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:53.027230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:53.027740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:53.107026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:53.108947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:53.164058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:53.220635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 84/164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:53.228595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:53.328170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:53.379511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc04fb4-5f8f-4405-a2c3-1c369905b2f3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:53.420692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:53.421329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:53.421611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:53.421882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:53.423719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:53.425338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:53.427114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 81/165] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:53 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:53.432992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:53.542124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f59e2-ab50-4394-84ca-89aba16bc10f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:53.578398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:53.579586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:53.579899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:53.580162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:53.580873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a3c66ed18b954814afb1ba80dd0f24ae) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:53.581176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:53.582630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:53.591614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 85/166] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:53 2022] GET /identity/v3/role_assignments?user.id=a3c66ed18b954814afb1ba80dd0f24ae&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:53.679346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:53.838886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10673f3-4ce4-4c7c-9b65-56dc32a24836 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:53.876588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:53.877232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:53.877510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:53.877780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:53.880872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:53.895879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:53.901041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:53.902151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:53.902928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:53.909556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 82/167] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:51:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:53.915430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:53.933394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:54.031681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd01e-4186-413b-aaf9-a2e4453c03a7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:54.069949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:54.070561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.070838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.071108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.071811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:54.072113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:54.073493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:54.082798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 86/168] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:51:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:54.088650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:54.233680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fea44-db35-4bf3-b041-f6c1dfe2bde5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:54.276444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:54.277436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.277930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.278407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.284317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:54.286066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:54.288400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 83/169] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:54 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:54.293567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:54.397122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:54.426177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf740bf-ac04-4827-9a0a-ec4494e7e15b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:54.471667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:54.472311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.472585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.472925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.552939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:54.554428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acd46b-a0c8-4b7e-8fd2-3212d56a448b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:54.655873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:54.686501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 87/170] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:54.692049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:54.722488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01596-bca9-47ca-89a8-783dcae2c968 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.722789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01596-bca9-47ca-89a8-783dcae2c968 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.723047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01596-bca9-47ca-89a8-783dcae2c968 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.725036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 88/171] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:54.737882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.738173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.738435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.771765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:54.773354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:54.828533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:54.887554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 89/172] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:54.935226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d72f5-b546-4651-a3e6-2bd06b8bb69d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:54.997092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:54.997735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:54.998016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:54.998288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:54.999448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:55.000989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:55.003965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 84/173] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:54 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:55.008762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:55.127961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5df11-ff44-4ac8-b6bd-7db341c9fd3a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:55.135819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:55.174126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:55.174743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.175023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.175289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.176057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:55.179862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:55.181318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe31d9-46c4-40c8-b1d5-fedd24904a26 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:55.187616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 90/174] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:55 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:55.415669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:55.519951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd505-0ba5-4f5a-9e0c-57b284422b0e None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.519951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd505-0ba5-4f5a-9e0c-57b284422b0e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.519951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfd505-0ba5-4f5a-9e0c-57b284422b0e None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.519951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 91/175] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:51:55.530863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c2cc8-4be1-448f-992a-abda40168fdf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.531150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c2cc8-4be1-448f-992a-abda40168fdf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.531425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c2cc8-4be1-448f-992a-abda40168fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.561640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-647c2cc8-4be1-448f-992a-abda40168fdf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:55.565185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-647c2cc8-4be1-448f-992a-abda40168fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:55.582228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1486edd-82a9-4bb8-aa99-366e3b3316d1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:55.637981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:55.657130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:55.658280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.658280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.662822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.685968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:55.692550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:55.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:55.694718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 85/176] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:55.701952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:55.702864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 92/177] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:55.848785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b888c2-1a91-463a-ba2c-aae49a5aa760 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:55.881063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d5bd-219b-4aff-ab0d-0301ab1e33a8 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.881417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d5bd-219b-4aff-ab0d-0301ab1e33a8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.881626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36d5bd-219b-4aff-ab0d-0301ab1e33a8 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.883149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 93/178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:55.893383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:55.893703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1944fe-7f25-4746-b57d-1096b19f9373 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.893994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1944fe-7f25-4746-b57d-1096b19f9373 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.894091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:55.894285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:55.894375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1944fe-7f25-4746-b57d-1096b19f9373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.894568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:55.895202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:55.896124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:55.896898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:55.906242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 86/179] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:55.913361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:55.925910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6b1944fe-7f25-4746-b57d-1096b19f9373 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:55.927112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6b1944fe-7f25-4746-b57d-1096b19f9373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:55.996565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.027490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 94/180] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:56.027490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9284b3-87b0-4a4e-a82d-8c74d0c4c85d None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.027490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9284b3-87b0-4a4e-a82d-8c74d0c4c85d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.027490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9284b3-87b0-4a4e-a82d-8c74d0c4c85d None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.027490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 95/181] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:56.043539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.043841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.044092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.074184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d301-3a56-4251-b3d2-dd84baf3991a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.077302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:56.078484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:56.119340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.134159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.134806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.135087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.135360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] PATH_INFO: `/v3/users/a2a1a361ba2441d093ccdff3013d4adb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.136569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] RBAC: Authorizing `identity:get_user(user_id=a2a1a361ba2441d093ccdff3013d4adb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.138005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.139929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 87/182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:55 2022] GET /identity/v3/users/a2a1a361ba2441d093ccdff3013d4adb => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:56.140716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.188859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 96/183] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:56.189499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.262429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4c9d-3537-4ba3-a874-547202c7af0b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.288573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.302011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.302652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.302799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b3b57-194a-4656-9888-f54cb9ea0661 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.302927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.303200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.315691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:56.322604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:56.323628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:56.324446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 88/184] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:56.330300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.344958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.345670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.345944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.346211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.379456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.423727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.425215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.448364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7afc-382b-45a2-9126-26cc18309961 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.487259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.487911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.488344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.488621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.489639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:56.490098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.491611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e8b7-7a5a-442d-924e-e94f8b594133 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.506558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 89/185] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:56.506558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac559-53f7-42a7-b73a-1bd85a34eb97 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.506558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac559-53f7-42a7-b73a-1bd85a34eb97 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.506558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac559-53f7-42a7-b73a-1bd85a34eb97 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.506914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 90/186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:56.507809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac559-53f7-42a7-b73a-1bd85a34eb97 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.543843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 97/187] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:56.543843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.563860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.600898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.619668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac559-53f7-42a7-b73a-1bd85a34eb97 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.642702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d894056-0795-4571-abb6-c31413fcd184 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.655044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.655707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.655987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.656258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.658046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.659492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b156b-7a46-498f-bb30-afd3f3be8318 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.661184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 91/188] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:56.662299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.662580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.663123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.676788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.677414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.677684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.677947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.681040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:56.682269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:56.691884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.693342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.694956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 98/189] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:56.695736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.751559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 92/190] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:51:56.752571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.797919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.814478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4cb05-fb3a-473d-a5b2-361fee2dcb26 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.833367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:56.851484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.852147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.852425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.852701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.859521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519ec04-39df-4642-9f57-894dd208d426 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:56.863243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:56.868225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:56.869184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:51:56.869952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 99/191] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:56.870603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.898417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:56.899054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:56.899336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:56.899794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] PATH_INFO: `/v3/projects/b675e3cebf08410291b99a695a50f2a9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:56.900758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] RBAC: Authorizing `identity:get_project(project_id=b675e3cebf08410291b99a695a50f2a9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:56.902186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:56.909203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 93/192] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/projects/b675e3cebf08410291b99a695a50f2a9 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:56.909203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:56.991242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38741cca-dedb-43fa-9cc4-d738058469b7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.017937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805168d-db37-49b3-8908-14df115c3833 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.026502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.027416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.027721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.027992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.028640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.029613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.030071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.052915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 100/193] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:51:56 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:51:57.053672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.055185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.055835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.056183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.056450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.094278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.136688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.138164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.170348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9aab6d-0f14-49ff-bb40-03ad7f077c2b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.208765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.209658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.209933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.210198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.211010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:57.211666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.213087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.222549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 101/194] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:57.223430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.257896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 94/195] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:57.258710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.273384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.351349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.361002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d8491-eb1c-4874-9d80-a1f912f4c579 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.400061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9baa3-07c2-4ad0-8164-544b02509203 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.406541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.407947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.408453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.409099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.409451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=b675e3cebf08410291b99a695a50f2a9, user.id=a2a1a361ba2441d093ccdff3013d4adb) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:57.409759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.411335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.417423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 102/196] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/role_assignments?user.id=a2a1a361ba2441d093ccdff3013d4adb&scope.project.id=b675e3cebf08410291b99a695a50f2a9&role.id=d56a4f333035431eb58b79b9117ac64d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:57.418182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.441266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.442286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.442570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.442841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.459950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:51:57.466693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:51:57.467672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:51:57.468487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 95/197] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:51:57.469929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.593380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf711-913f-48ef-8c4b-94a82a8da2e3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.603911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.659690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.660364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.660613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.661054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.661751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148379b5-6dc4-4f2d-986c-935b43bb18a7 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.662572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.664289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.666848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 103/198] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:57.668699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.707839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.708023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.708627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.708904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.709166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.711733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.713236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.715190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 96/199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:57.715992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.802538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475c501-4b47-4c40-ba4d-a2802fc1eb44 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.842681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.843293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.843610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.843881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.844626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:57.844959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.846575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:57.850004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41d8f-88bc-4cb0-89a4-3f964a837fb3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.856417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 104/200] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:57.857013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:57.895579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:57.896198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:57.896478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:57.896751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:57.905423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.958991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:57.969645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b338a-8f8a-4885-8003-b6b4a58a0496 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:57.976928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:57.978649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.010274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.011152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.011583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.011977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.012815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=4f6c8af2dac3468185ed324b1c0a943e) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:58.013257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.014808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.021251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 105/201] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/role_assignments?user.id=4f6c8af2dac3468185ed324b1c0a943e&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:58.022347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:58.121371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 97/202] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:51:58.127983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:58.133283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5b29f-ceab-400a-a0e8-fee20e287ccb None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:58.173427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.174439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.174944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.175417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] PATH_INFO: `/v3/users/7c7ff5e350e04859956e5127dd04574f` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.176919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] RBAC: Authorizing `identity:get_user(user_id=7c7ff5e350e04859956e5127dd04574f)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.178632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.180848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 106/203] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/users/7c7ff5e350e04859956e5127dd04574f => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:58.187337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:58.217766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:58.231835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:58.327501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bac29-81a0-494e-ac33-6dd407dc86a8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:58.350036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785dcf-21e1-4ce3-bd3a-afe1ff056883 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:58.368586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.369276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.369560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.369836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.371765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.373174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.375734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 98/204] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:51:58.388028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:58.433571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.434198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.434476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.434752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.563710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.565480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.614375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:58.623247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91f45-1be9-4f41-8054-5338306a15f3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:58.637630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:58.720803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 107/205] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:51:58.727144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:58.736275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.736882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.737158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.737420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.738135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=4f6c8af2dac3468185ed324b1c0a943e) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:58.738432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.739887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.745654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 99/206] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/role_assignments?user.id=4f6c8af2dac3468185ed324b1c0a943e&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:58.844342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a052-9357-4d4d-9d3e-9661976e4f45 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:58.871157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:58.884380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:58.884938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:58.885219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:58.885492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:58.886717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:58.888330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660783b-3404-41bc-a4c3-5921becc1b42 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:58.890403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 108/207] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:58.896792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:51:59.029403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c71f8-f989-4d96-b265-696e9a101b46 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:51:59.066683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:51:59.067290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:59.067593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:59.067866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:59.068592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, scope.project.id=281dbf41df714fa893132448a05fbc5e, user.id=7c7ff5e350e04859956e5127dd04574f) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:51:59.068956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:51:59.070431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1621e-f39f-4de7-86c0-82add8848b14 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:51:59.077005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 100/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:51:58 2022] GET /identity/v3/role_assignments?user.id=7c7ff5e350e04859956e5127dd04574f&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=e5723533747d4566b5e168d4b16e0567 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:51:59.837307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bdb6-dd66-45a8-93fc-ff9b49afd023 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:59.837777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bdb6-dd66-45a8-93fc-ff9b49afd023 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:59.837777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171bdb6-dd66-45a8-93fc-ff9b49afd023 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:59.839114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 109/209] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:59.844819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb900-e468-44de-b554-7ae69b101873 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:59.845347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb900-e468-44de-b554-7ae69b101873 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:59.845449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb507fa-bc81-475b-95a5-8c5afc561044 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:59.845655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb507fa-bc81-475b-95a5-8c5afc561044 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:59.845928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb507fa-bc81-475b-95a5-8c5afc561044 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:59.846287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb900-e468-44de-b554-7ae69b101873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:59.847379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 110/210] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:51:59.852700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:51:59.852985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:51:59.853262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:51:59.868859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-09feb900-e468-44de-b554-7ae69b101873 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:59.870050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-09feb900-e468-44de-b554-7ae69b101873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:59.873748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:51:59.875109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:51:59.907711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:51:59.959499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 101/211] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:51:59.967175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 111/212] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:00.227721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb900-e468-44de-b554-7ae69b101873 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.243710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.342207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feb900-e468-44de-b554-7ae69b101873 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:00.371423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b76c39-db63-46c1-b141-4aee3cef8f71 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:00.393163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:00.394557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.395047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.395536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.397343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:00.398960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:00.402595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:00.410392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 102/213] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:00.412402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.428601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:00.429901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.430967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.431454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.449672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:00.451164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:00.458823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:00.459746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:00.460501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:00.463716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 112/214] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:00.468633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.540216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cb465-4fa2-4eac-99c4-904300f6525a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:00.576778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:00.577384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.577653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.577916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.578654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:00.580613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27559e-6945-46c5-a2e9-89fb4cfc8ff3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:00.589008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb202bec-a6d1-4e87-bbe4-95d4e6985bd6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:00.605236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 103/215] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:00 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:00.606573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b0ed-4b47-4460-b612-be92d40646b2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.606921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b0ed-4b47-4460-b612-be92d40646b2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.607281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b0ed-4b47-4460-b612-be92d40646b2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.608736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 104/216] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:00.615583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.616184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.616635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.637498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:00.638235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.638581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.638918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.639712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:00.640099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:00.640362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:00.642489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:00.643000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:00.652621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 113/217] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:00.658232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.734592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 105/218] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:00.735635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:00.799197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9d34a-07e4-40ae-9842-136b70c3d4fa None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:00.836003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:00.836750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:00.837030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:00.837326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] PATH_INFO: `/v3/users/ca8ba00165a144d8a0cb9be3838f7a15` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:00.852021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] RBAC: Authorizing `identity:get_user(user_id=ca8ba00165a144d8a0cb9be3838f7a15)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:00.853488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:00.855441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 114/219] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:00 2022] GET /identity/v3/users/ca8ba00165a144d8a0cb9be3838f7a15 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:00.861471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:00.882205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:00.973861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb195d-29a1-4a7c-9797-c1e6490a61c4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.010969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.011618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.011898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.012342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.013268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.113756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:01.115508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:01.151069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.162559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.167188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c356c-332b-4a00-af01-43963333dc95 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.210250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.211012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.211336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.211807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.223370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-e9610129-9318-440b-9c1d-f9cd40cb0dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:01.228783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:01.229664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:01.230425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 115/220] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:01.231053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552cb-53ca-4ba4-a628-375dad8bd980 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.231710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552cb-53ca-4ba4-a628-375dad8bd980 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.231710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d552cb-53ca-4ba4-a628-375dad8bd980 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.232907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 116/221] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:01.240446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.240807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.241348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.259693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 106/222] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:01.260802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.267239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:01.268620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:01.354941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 117/223] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:01.356015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.410355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f56e2-2531-49ff-87c1-16ae81a0393b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.443875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.483448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.484077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.484347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.484611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.485851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:01.486280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:01.487664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:01.504289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 107/224] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:01.515700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.530221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.550560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158b58a-30e1-40b2-b1db-da5138f992cf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.594777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.595412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.595710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.595973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.597149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:01.598588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:01.600241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 118/225] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:01.609573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.670790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ffcca-aa39-4087-a8f8-e2de5a35a0b1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.709547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.710185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.710462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.710729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.712004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:01.713658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:01.715516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 108/226] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:01.716137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.745087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53b6e0-27ae-42a9-a47d-edcacee90dc6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.771539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.786669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.787784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.788259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.788721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.789637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=ca8ba00165a144d8a0cb9be3838f7a15) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:01.790138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:01.792035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:01.798393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 119/227] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/role_assignments?user.id=ca8ba00165a144d8a0cb9be3838f7a15&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=d56a4f333035431eb58b79b9117ac64d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:01.799483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:01.847480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:01.865306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aabf80-b711-4574-812d-d698c3a367e2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.945863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:01.946431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:01.946705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:01.946967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:01.978835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afdca7-7c9d-4c40-97a7-9bcd41ada8e5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:01.980181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:01.986511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:01.987445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:01.988270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 109/228] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:01.994375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:02.031415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.033618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.034106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.034829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.037807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.040059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.042375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 120/229] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:02.048636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:02.124636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113299e-0a73-4254-a334-46a3f92e0e49 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:02.134947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:02.162088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.163056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.163576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.164055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.164911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:02.165406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.166990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.176685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 110/230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:02.183070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:02.226283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:02.244538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c447b7-b0d4-423e-a340-20810b7b565c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:02.311659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.312396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.312950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.313790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/4f6c8af2dac3468185ed324b1c0a943e/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.315995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, user_id=4f6c8af2dac3468185ed324b1c0a943e, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.317507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.344382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 121/231] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:02 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/4f6c8af2dac3468185ed324b1c0a943e/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:02.364448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903c47a-29f1-452e-9923-49c713308f9f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:02.420147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.421060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.421505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.421914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.425911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.427788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.430007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 111/232] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:02 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:02.436118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:02.588388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837bead-9fda-4d74-bae1-bd08a8a0df7f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:02.626084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.626737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.627012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.627279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.628501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.629951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21897e4-1d44-4fd5-a9dc-3505417435cb None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.631669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 122/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:02 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:02.637354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:02.684651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:02.748221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622514-333f-475d-8fb1-5eada670bc25 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:02.800533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:02.801568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:02.802129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:02.802663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/4f6c8af2dac3468185ed324b1c0a943e/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:02.807180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, user_id=4f6c8af2dac3468185ed324b1c0a943e, role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:02.809283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c01ca-d611-4791-8fe9-ea1c88d77f93 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:02.829465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 112/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:02 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/4f6c8af2dac3468185ed324b1c0a943e/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:03.340407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5584-bb85-42d3-ba8a-d2c498b48252 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:03.340915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5584-bb85-42d3-ba8a-d2c498b48252 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:03.340988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e5584-bb85-42d3-ba8a-d2c498b48252 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:03.342298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 123/235] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:03.348689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa3fe-8ad3-4eb7-a7d1-5da419075aec None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:03.349146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa3fe-8ad3-4eb7-a7d1-5da419075aec None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:03.349220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfa3fe-8ad3-4eb7-a7d1-5da419075aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:03.377328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-19bfa3fe-8ad3-4eb7-a7d1-5da419075aec None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:03.378551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19bfa3fe-8ad3-4eb7-a7d1-5da419075aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:03.461132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 113/236] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:03.643918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e2614-da02-46ae-b54b-9aeb45ddefe3 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:03.644271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e2614-da02-46ae-b54b-9aeb45ddefe3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:03.644463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e2614-da02-46ae-b54b-9aeb45ddefe3 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:03.645811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 124/237] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:03.652724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:03.653010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:03.653284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:03.684458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:03.685647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:03.714708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:03.777823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 114/238] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:03.859434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e2614-da02-46ae-b54b-9aeb45ddefe3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:03.889012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:03.977462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e2614-da02-46ae-b54b-9aeb45ddefe3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.013282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.013919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.014195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.014465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.015593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:04.017206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:04.018826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 125/239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:04.024618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:04.100923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:04.132117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608ff50-a411-405e-a329-3a66d7a78eb9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.195699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.196706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.197183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.198527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.199397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:04.201953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:04.240314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 115/240] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:04 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:04.278670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:04.298226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92825592-0a2e-4ff9-a13b-9eb50609b19a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.351195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.351968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.352157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.352401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.371903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:04.377983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:04.378892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:04.379677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:04.380723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 126/241] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:04.385240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:04.403857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:04.500111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b81b5-6572-4965-a158-eb26cfbd0fcd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.537695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.538322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.538600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.538872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.539577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:04.539883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:04.541252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:04.550978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 116/242] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:04.557402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:04.687054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2be6-d637-4ff4-a8b6-2d7d14b248ba None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.736277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.736936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.737214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.737487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] PATH_INFO: `/v3/users/ef2bc3b198be475b9b299750ebd0d966` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.756154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ef2bc3b198be475b9b299750ebd0d966)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:04.757573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4855-d816-4588-987e-879abbdbc2f3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:04.759617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 127/243] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:04 2022] GET /identity/v3/users/ef2bc3b198be475b9b299750ebd0d966 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:04.765014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:04.859168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7c9d-b0db-4312-9967-a0619a13cb2c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.859499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7c9d-b0db-4312-9967-a0619a13cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.859754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7c9d-b0db-4312-9967-a0619a13cb2c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.862020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 128/244] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:04.868413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ad3e-9b5e-482f-95bf-8c5f873d39fe None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.868693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ad3e-9b5e-482f-95bf-8c5f873d39fe None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.868967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ad3e-9b5e-482f-95bf-8c5f873d39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:04.870172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:04.879392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:04.895652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f363ad3e-9b5e-482f-95bf-8c5f873d39fe None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:04.896408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22422c-168c-4cc3-b359-99f3a0e3bd4a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:04.896848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f363ad3e-9b5e-482f-95bf-8c5f873d39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:04.935095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:04.935744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:04.936024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:04.936305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.007786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 129/245] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:05.016235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:05.018593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:05.099742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:05.119864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555df-c3cc-4cc0-923b-f94c2e4633a2 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.120558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555df-c3cc-4cc0-923b-f94c2e4633a2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.121048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152555df-c3cc-4cc0-923b-f94c2e4633a2 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.122893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 130/246] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:05.127510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 117/247] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:05.129064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.129350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.129626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.131093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:05.162057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:05.163244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:05.296960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 131/248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:05.305387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0778df-9ac9-4ddd-baa2-1f50d88ef98e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:05.366515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:05.367154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.367431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.367735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.372160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:05.373626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:05.375295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 118/249] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:05.382739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:05.383354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:05.432225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:05.510013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:05.557916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989682-5f42-4277-b7b1-6b72a1a001ed None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:05.587722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6b25b-408a-459d-82ee-bd98d2c1f826 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:05.638124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:05.638781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.639054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.639314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.646564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:05.647186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.647490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.647765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.648517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=ef2bc3b198be475b9b299750ebd0d966) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:05.648828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:05.650332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:05.659675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 132/250] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/role_assignments?user.id=ef2bc3b198be475b9b299750ebd0d966&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=e5723533747d4566b5e168d4b16e0567 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:05.669557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:05.674860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:05.675937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:05.676707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 119/251] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:05.681962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:05.728170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:05.853611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab2f05-4083-4c55-9da7-5f6ac26ab027 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:05.854873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:05.912729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:05.913813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.914194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.914561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.927659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:05.932055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a91be1-1217-49e1-9111-d549bd8a8ef0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0d4ea0b2-b2c9-4eac-9590-641b204eedfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:05.939493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:05.940456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 120/252] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:05.941214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840f2e-63e9-4bd2-a25e-df6076a0d8e6 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:05.941928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840f2e-63e9-4bd2-a25e-df6076a0d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:05.941928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec840f2e-63e9-4bd2-a25e-df6076a0d8e6 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:05.945904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 121/253] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:05.946825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec840f2e-63e9-4bd2-a25e-df6076a0d8e6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.001451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:06.016747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.017527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.017810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.018536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.019212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:06.019542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.021348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06923a1-3a29-4c6b-a1ed-52045ed92906 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.045585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 133/254] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:06.046846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.047129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.052531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.089538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:06.090731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:06.137411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec840f2e-63e9-4bd2-a25e-df6076a0d8e6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.206428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.207046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.207322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.207616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.208288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:06.208588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.209952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.225488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 122/255] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:06.226320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.237260 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 134/256] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:06.238123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.300871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:06.383833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cb94f-6e59-45bc-888c-5774e59cb7d4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.422340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.423253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.423714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.424154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] PATH_INFO: `/v3/users/ca8ba00165a144d8a0cb9be3838f7a15` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.425472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] RBAC: Authorizing `identity:get_user(user_id=ca8ba00165a144d8a0cb9be3838f7a15)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.427546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.429305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 123/257] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:06 2022] GET /identity/v3/users/ca8ba00165a144d8a0cb9be3838f7a15 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:06.435146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.485732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02219377-d00c-47fc-9d88-4d1ddbfc50e6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.536217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:06.564473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:06.575632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458f98a-b20a-422b-882e-8a6f3cc2da7e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.584388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.585047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.585326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.585595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.587510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.588973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.590734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 135/258] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:06 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:06.597863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.634052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.634934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.635350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.635797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.637072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.638630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.640720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 124/259] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:06 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:06.647530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.791841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b61-cdac-4a32-9a11-7e4b296510b6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.832143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.833149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.833568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.834028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/ca8ba00165a144d8a0cb9be3838f7a15/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:06.836198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, user_id=ca8ba00165a144d8a0cb9be3838f7a15, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:06.837844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:06.854195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e8de-ea04-41da-b8fc-7d414d57b922 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:06.856948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 125/260] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:06 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/ca8ba00165a144d8a0cb9be3838f7a15/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:06.858541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:06.929314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:06.955489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:06.956115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:06.956392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:06.956661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.075595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:07.093766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5731-6448-4eb2-8b55-428a527b9986 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:07.100469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:07.107749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:07.168238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:07.169184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.170838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.171271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.197244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:07.205441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:07.206514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:07.207334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:07.212927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 126/261] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:07.220960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:07.316927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 136/262] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:07.321304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:07.369869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:07.391098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab109e89-51ac-4c60-a161-d6a9e930536d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:07.428951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:07.429557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.429836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.430102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.430763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:07.431057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:07.433074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:07.444249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 127/263] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:07.453010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:07.511100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:07.546007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5744527-75cb-4208-a8db-d4bd2378439b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:07.640307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:07.640936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.641860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.642138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.644862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:07.646334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:07.648039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 137/264] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:07 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:07.654891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:07.713680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a135c-f8a6-4d5d-963c-22b5dbc12720 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:07.801546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568c41-7171-483f-b0ea-4121a179e4ca None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:07.808786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:07.809447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.809731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.810005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] PATH_INFO: `/v3/users/4f6c8af2dac3468185ed324b1c0a943e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.811201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] RBAC: Authorizing `identity:get_user(user_id=4f6c8af2dac3468185ed324b1c0a943e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:07.813150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:07.820093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 128/265] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:07 2022] GET /identity/v3/users/4f6c8af2dac3468185ed324b1c0a943e => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:07.821886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:07.852902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:07.853523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.853791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.854054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.854779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=4f6c8af2dac3468185ed324b1c0a943e) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:07.855080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:07.856551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc7446-8946-4537-abf4-45cb78f4fa3d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:07.862941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:07.865957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 138/266] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:07 2022] GET /identity/v3/role_assignments?user.id=4f6c8af2dac3468185ed324b1c0a943e&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:07.929472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd372-f5ad-41b3-a8c2-5e21ef6db3f1 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.929762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd372-f5ad-41b3-a8c2-5e21ef6db3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.929927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edd372-f5ad-41b3-a8c2-5e21ef6db3f1 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.931545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 139/267] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:07.936640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddbd4f-3597-465f-9f35-5f28145bdafa None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:07.936919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddbd4f-3597-465f-9f35-5f28145bdafa None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:07.937190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddbd4f-3597-465f-9f35-5f28145bdafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:07.970533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-deddbd4f-3597-465f-9f35-5f28145bdafa None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:07.979923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-deddbd4f-3597-465f-9f35-5f28145bdafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:08.004378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:08.024862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a49de7-9f79-4481-a2e2-265531f1d495 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:08.088110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:08.088809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.089095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.089365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.125706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 140/268] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:08.126995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78023-e8f9-46b4-9fb2-2784630501b0 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.127274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78023-e8f9-46b4-9fb2-2784630501b0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.127564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c78023-e8f9-46b4-9fb2-2784630501b0 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.129047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 141/269] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:08.148944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.149265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.149477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.177360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:08.178941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:08.192189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:08.193298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:08.212444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:08.309612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 129/270] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:08.311455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:08.338296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 142/271] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:08.453306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282daf5e-1034-43ce-911b-2b00860a8579 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:08.479844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:08.494906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:08.495640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.495918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.496191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.497371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:08.498924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:08.506133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 130/272] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:08 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:08.508551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:08.537885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:08.637244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:08.662550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04878bbe-b9db-4e25-876f-4c0158392bb8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:08.678284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844d671-aec1-42cb-9e0d-b4179bc9515b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:08.701201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:08.701854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.702136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.702411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.703673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:08.705112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:08.707077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 131/273] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:08.712289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:08.748485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:08.749091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.749361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.749628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.750875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=4f6c8af2dac3468185ed324b1c0a943e) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:08.751183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:08.752639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e8ab5-9a35-491c-a1e6-b2409adb8672 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:08.762352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 143/274] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:08 2022] GET /identity/v3/role_assignments?user.id=4f6c8af2dac3468185ed324b1c0a943e&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:08.762352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c1b5-29de-41e7-92ce-1286d4b397fc None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.762352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c1b5-29de-41e7-92ce-1286d4b397fc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.762352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651c1b5-29de-41e7-92ce-1286d4b397fc None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.762352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 144/275] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:08.768328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.768612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.768929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.791814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:08.793336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:08.795836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:08.880912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076113f2-df30-4543-805e-3215bc72da18 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:08.914566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 145/276] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:08.915746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:08.930657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:08.931278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:08.931573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:08.931840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:08.932503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:08.933968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:08.975357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 132/277] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:08 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:09.036846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:09.068711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d83f5e-3f9f-4411-a717-f0f68a0f6264 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.110185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.111416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.111943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.112440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.125020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:09.131239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:09.132226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:09.133033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:09.136592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 146/278] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:09.142340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.233155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.277417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12b3d-d2d2-4133-8cee-4d37f77fc151 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.280865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:09.321832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.322472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.322746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.323012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.323700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:09.323999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:09.325347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:09.335542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 133/279] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:09.340538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.378913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e621-8609-4dda-8b5f-5ce28bc1066b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.417214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.417853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.418132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.418398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.422092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:09.434366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:09.441543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:09.442484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:09.443262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 147/280] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:09.448905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.468577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4cb01-f4ac-4682-a5d3-e611d60bc86e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.511373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.512239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.512520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.512788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] PATH_INFO: `/v3/users/f5cef4a1a61342a9aef676db2881ab40` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.539499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] RBAC: Authorizing `identity:get_user(user_id=f5cef4a1a61342a9aef676db2881ab40)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:09.542179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:09.545124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 134/281] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/users/f5cef4a1a61342a9aef676db2881ab40 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:09.552307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.584070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d58cc-b9bf-4ab6-bdf1-e6af63b819b2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.590916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:09.649703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.650325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.651639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.651923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.652612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:09.652918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:09.654326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:09.675193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 148/282] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:09.681873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:09.733114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db98c-2a27-4d54-bce0-36e987d7bd0c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.757083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:09.778416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.778950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.779226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.779520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.780255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, user.id=f5cef4a1a61342a9aef676db2881ab40, scope.system=all) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:09.780559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:09.782118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e231-61a4-4887-85b5-203c69028d19 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:09.788857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 135/283] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/role_assignments?user.id=f5cef4a1a61342a9aef676db2881ab40&scope.system=all&role.id=d56a4f333035431eb58b79b9117ac64d => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:09.795988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cb5e-e563-4f03-8221-5108b91d8170 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.795988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cb5e-e563-4f03-8221-5108b91d8170 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.795988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47cb5e-e563-4f03-8221-5108b91d8170 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.795988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 136/284] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:09.798969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.799252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.799554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.830125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:09.834158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:09.854787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f308d-04dd-432d-aaf0-d589a741eaa6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:09.939663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:09.940686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:09.941162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:09.941696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] PATH_INFO: `/v3/users/ef2bc3b198be475b9b299750ebd0d966` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:09.943509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] RBAC: Authorizing `identity:get_user(user_id=ef2bc3b198be475b9b299750ebd0d966)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:09.945224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:09.949224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 149/285] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/users/ef2bc3b198be475b9b299750ebd0d966 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:09.970569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:10.002928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 137/286] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:10.101705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6862-e357-4bd8-85e8-4effb00b0236 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:10.139834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:10.151004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:10.152029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:10.152720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:10.152996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:10.154165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:10.155664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:10.158299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 150/287] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:09 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:10.163974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:10.196341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:10.290180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9ea9f-5e9b-4250-8fed-fa30032c4d2a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:10.335062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:10.336111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:10.336589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:10.337097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/ef2bc3b198be475b9b299750ebd0d966/roles/e5723533747d4566b5e168d4b16e0567` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:10.339295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, user_id=ef2bc3b198be475b9b299750ebd0d966, role_id=e5723533747d4566b5e168d4b16e0567)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:10.340962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:10.357586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 138/288] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:10 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/users/ef2bc3b198be475b9b299750ebd0d966/roles/e5723533747d4566b5e168d4b16e0567 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:10.441044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:10.578972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dda93-8feb-4c5e-979c-6d0a33e2f074 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:10.615095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:10.615895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:10.616172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:10.616445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:10.627839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:10.633220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:10.634080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:10.634843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 151/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:10.640183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:10.754284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:10.787998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd19f1-12d6-4c15-b7e0-fdd56456ba86 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:10.831501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:10.832492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:10.832992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:10.833458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:10.834315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:10.834809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:10.836391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:10.851751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 139/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:10.857582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:10.949799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.005278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e68a52-ad5c-4e32-bc26-cbddc89ca95f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:11.046643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:11.047365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.047671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.047941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] PATH_INFO: `/v3/users/ca8ba00165a144d8a0cb9be3838f7a15` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.052224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] RBAC: Authorizing `identity:get_user(user_id=ca8ba00165a144d8a0cb9be3838f7a15)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:11.053913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:11.055780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 152/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:10 2022] GET /identity/v3/users/ca8ba00165a144d8a0cb9be3838f7a15 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:11.061695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:11.212568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99492f-ac36-4920-8bb9-ab715c4c8380 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:11.258572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:11.259192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.259494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.259760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.275204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.354118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:11.355578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:11.496946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 140/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:11.503698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:11.664087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c646c4-a2cf-42d2-bd67-a05b6e4dcd19 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:11.684726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.706568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:11.707208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.707504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.707891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.709042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:11.710488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b307ef-e6fb-44f1-a2bf-3eb5fbd7dc1c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:11.712310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 153/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:11 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:11.720950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:11.785732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:11.860499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3933e8-8bf9-4884-8ae3-d4d24e9835d1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:11.868820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ed0b3-68e7-4fa5-aa7c-9b4b6fcdd268 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.869689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ed0b3-68e7-4fa5-aa7c-9b4b6fcdd268 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.870179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ed0b3-68e7-4fa5-aa7c-9b4b6fcdd268 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.871940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 154/294] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:11.877219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4e47-0376-4266-9503-acdad610e1c8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.877716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4e47-0376-4266-9503-acdad610e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.878179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f4e47-0376-4266-9503-acdad610e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.901547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:11.902515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:11.904916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:11.905381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:11.906342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=ca8ba00165a144d8a0cb9be3838f7a15) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:11.907529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:11.909153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67112ca0-3398-4ff2-a35b-36c47421ca29 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:11.918853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-455f4e47-0376-4266-9503-acdad610e1c8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:11.920506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-455f4e47-0376-4266-9503-acdad610e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:11.925199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 141/295] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:11 2022] GET /identity/v3/role_assignments?user.id=ca8ba00165a144d8a0cb9be3838f7a15&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=d56a4f333035431eb58b79b9117ac64d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:12.038206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 155/296] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:12.248958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1f60-e31a-47d4-915e-435c35e5b6fa None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.249314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1f60-e31a-47d4-915e-435c35e5b6fa None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.249489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1f60-e31a-47d4-915e-435c35e5b6fa None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.251761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 142/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:12.257096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300547ce-e990-4831-8844-483555b79ff1 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.257381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300547ce-e990-4831-8844-483555b79ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.257658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300547ce-e990-4831-8844-483555b79ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.280765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-300547ce-e990-4831-8844-483555b79ff1 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:12.291332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-300547ce-e990-4831-8844-483555b79ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:12.336718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1f60-e31a-47d4-915e-435c35e5b6fa None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.376063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 156/298] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:12.455018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1f60-e31a-47d4-915e-435c35e5b6fa None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:12.457952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:12.493196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:12.493887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.494110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.494376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.505764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:12.510919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:12.511823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:12.512597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 143/299] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:12.520339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300547ce-e990-4831-8844-483555b79ff1 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.580393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:12.638648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300547ce-e990-4831-8844-483555b79ff1 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:12.674061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:12.674675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.674949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.675217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.675905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:12.676208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:12.677658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:12.686253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 157/300] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:12.692754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.693072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.803291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a178a-f180-42b1-b8a7-6784d0e59cc9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:12.803862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391539c-51a8-4391-bba7-fcaf8ab018c0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:12.815429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:12.841583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:12.841757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:12.842133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.842298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.842390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.842553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.842646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.842827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] PATH_INFO: `/v3/users/4d1f149c9e6244049d5d07249a53a2c1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.843776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:12.845266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10519df5-f175-4d07-901b-42c09ad6a896 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:12.846840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 144/301] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:12.848109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebf7f-f439-48cf-aa6d-fe312d8d32aa None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.848384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebf7f-f439-48cf-aa6d-fe312d8d32aa None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.848649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebf7f-f439-48cf-aa6d-fe312d8d32aa None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.850039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 145/302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:12.854523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ebf7f-f439-48cf-aa6d-fe312d8d32aa None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.865773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] RBAC: Authorizing `identity:get_user(user_id=4d1f149c9e6244049d5d07249a53a2c1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:12.867985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733e23-57cb-42cd-9bb2-457a57762322 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:12.874554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 158/303] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:12 2022] GET /identity/v3/users/4d1f149c9e6244049d5d07249a53a2c1 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:12.874554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:12.874554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:12.874554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:12.892465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:12.893688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:12.897325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:12.966698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 159/304] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:12.967655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:12.981583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ebf7f-f439-48cf-aa6d-fe312d8d32aa None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.018749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.019352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.019664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.019935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] PATH_INFO: `/v3/groups` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.020563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.021981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fef4e7-8f40-4dbe-a247-4eb0e3473ef6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:13.038086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 146/305] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Sep 7 12:52:12 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:13.046447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc464-0400-4ce9-950d-e8a52d908113 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.046752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc464-0400-4ce9-950d-e8a52d908113 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.046985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dc464-0400-4ce9-950d-e8a52d908113 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.051522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 147/306] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:13.056700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.057107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.057470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.084994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:13.086542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:13.104498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.111862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fcad7-36ab-4ae3-a891-ba034beab00a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.161864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.162702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.163067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.163430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.164285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, user.id=4d1f149c9e6244049d5d07249a53a2c1, scope.system=all) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:13.164686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.166272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:13.172792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 160/307] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Sep 7 12:52:12 2022] GET /identity/v3/role_assignments?user.id=4d1f149c9e6244049d5d07249a53a2c1&scope.system=all&role.id=e5723533747d4566b5e168d4b16e0567 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:13.183623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 148/308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:13.255456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.378427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729098dc-585a-4dbc-b934-73d46c3ce743 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.413054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.413735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.414009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.414276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.425584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:13.430950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:13.431875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:13.432730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 161/309] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:13.440274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.465212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.478786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.512870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.554815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3d517-0a5e-4c02-a6ee-6b68f77dc22b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.594065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01b66-b8c4-4fdd-8074-d7ea765a8273 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.602232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.603093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.603581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.604571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.605876 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:13.606538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.608464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:13.629615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 149/310] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:13.630291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.639405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.640077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.640349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.640615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.654753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:13.663741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:13.664660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:13.665439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:13.668069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 162/311] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:13.674893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.748836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.770478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17666df-5a8b-4306-adc8-823bf41a51e9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.787218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:13.814568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc96a6-bc38-437b-b81c-2f4d17d8deca None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.816118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.816788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.817072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.817407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] PATH_INFO: `/v3/users/f5cef4a1a61342a9aef676db2881ab40` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.820376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] RBAC: Authorizing `identity:get_user(user_id=f5cef4a1a61342a9aef676db2881ab40)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.822086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:13.824025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 150/312] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/users/f5cef4a1a61342a9aef676db2881ab40 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:13.829824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.854808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.855413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.855740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.856009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.856771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:13.856969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.858423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:13.868146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 163/313] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:13.877006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:13.949726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0047095-2e0a-4667-8816-02faf698f96a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.988476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4e2b-45ab-4775-beef-3ca1262f4517 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:13.989775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:13.990720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:13.991249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:13.991775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] PATH_INFO: `/v3/system/users/f5cef4a1a61342a9aef676db2881ab40/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:13.993448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5cef4a1a61342a9aef676db2881ab40, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:13.995088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:14.005816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 151/314] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Sep 7 12:52:13 2022] PUT /identity/v3/system/users/f5cef4a1a61342a9aef676db2881ab40/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:52:14.033048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:14.033696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:14.034090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:14.034582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] PATH_INFO: `/v3/users/ef2bc3b198be475b9b299750ebd0d966` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:14.036674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] RBAC: Authorizing `identity:get_user(user_id=ef2bc3b198be475b9b299750ebd0d966)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:14.039154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:14.041821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 164/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:13 2022] GET /identity/v3/users/ef2bc3b198be475b9b299750ebd0d966 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:14.048369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:14.071755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:14.178479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7acb-2ff0-4368-b3af-68bbfe0c9eb9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:14.216980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:14.217508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:14.217783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:14.218051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:14.291400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:14.292933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:14.315859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:14.400915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 152/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:14.409548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:14.424311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:14.516708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742c53-0470-4aca-85db-cbe0647406f6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:14.557179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:14.557811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:14.558149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:14.558423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:14.559615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:14.561157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccac9a-523f-4a5b-b4d5-4f5b386e6b55 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:14.564210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 165/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:14 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:14.570147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:14.679454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20341ad2-82c4-4ce1-aa2c-e0c3b8e96211 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:14.697704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:14.715757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:14.716353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:14.716622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:14.716885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:14.717597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb, user.id=ef2bc3b198be475b9b299750ebd0d966) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:14.717896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:14.719341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003cb1-43f4-4464-bf50-18f481839d84 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:14.725522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 153/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:14 2022] GET /identity/v3/role_assignments?user.id=ef2bc3b198be475b9b299750ebd0d966&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=e5723533747d4566b5e168d4b16e0567 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:15.401405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee9d5-b59d-4172-9608-3df67be805ce None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.401941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee9d5-b59d-4172-9608-3df67be805ce None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.401941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee9d5-b59d-4172-9608-3df67be805ce None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.403265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 166/319] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:15.408584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.409000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.409090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.427890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:15.429090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:15.449073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bef40f-77ae-4338-a572-40f08623f850 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.449574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bef40f-77ae-4338-a572-40f08623f850 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.449682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bef40f-77ae-4338-a572-40f08623f850 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.451108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 167/320] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:15.456318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.456575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.456852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.475243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:15.476466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:15.508657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 154/321] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:15.550933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 168/322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:15.778127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:15.823714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:15.835429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:15.885140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bea98b-79e1-485d-af2a-f674cecf8678 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:15.896560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:15.921406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:15.922596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.922977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.923251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.924527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:15.925958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:15.927561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 155/323] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:15.933073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:15.935825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2c4c6-c3af-482e-8372-638c31b5c303 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:15.972519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:15.973385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:15.973799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:15.974200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:15.989963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:15.998529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:15.999419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:16.000968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:16.006877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 169/324] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:16.007953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:16.054853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4969cf3-ce92-46a3-8a9b-a377b7b8fe1e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:16.081975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:16.093675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:16.094375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.094690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.094956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] PATH_INFO: `/v3/groups` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.095783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:16.097102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:16.116368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbd95-f18c-421e-9992-274f5767cb59 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:16.122898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 156/325] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Sep 7 12:52:15 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:16.156140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:16.157335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.157622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.157990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.158661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:16.158988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:16.160509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb9162-af57-4092-b048-59dfe318688f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:16.170001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 170/326] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:16.176660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:16.222663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:16.292007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696299-3525-42f8-a5cb-6d136997ade2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:16.331697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702524-1c11-4a76-934b-877c4c97ec66 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.331883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702524-1c11-4a76-934b-877c4c97ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.332185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702524-1c11-4a76-934b-877c4c97ec66 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.334197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 171/327] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:16.339858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.340243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.340520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.340781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:16.341660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.341862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.342154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] PATH_INFO: `/v3/users/4d1f149c9e6244049d5d07249a53a2c1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.343415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] RBAC: Authorizing `identity:get_user(user_id=4d1f149c9e6244049d5d07249a53a2c1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:16.345464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:16.347130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 157/328] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:16 2022] GET /identity/v3/users/4d1f149c9e6244049d5d07249a53a2c1 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:16.353240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:16.368527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:16.370643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:16.460769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 172/329] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:16.485958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506704ec-6e1d-4293-945b-99c6f29e09dc None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:16.494348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:16.528397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:16.528397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.528689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.530942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] PATH_INFO: `/v3/system/users/4d1f149c9e6244049d5d07249a53a2c1/roles/e5723533747d4566b5e168d4b16e0567` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.532653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d1f149c9e6244049d5d07249a53a2c1, role_id=e5723533747d4566b5e168d4b16e0567)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:16.534257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:16.542590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 158/330] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Sep 7 12:52:16 2022] PUT /identity/v3/system/users/4d1f149c9e6244049d5d07249a53a2c1/roles/e5723533747d4566b5e168d4b16e0567 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:52:16.739565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:16.807998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:16.849621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46260d-1582-403d-8e0c-a222266c9282 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:16.886703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:16.887339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:16.887644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:16.887913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:16.899837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:16.904839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:16.905687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:16.907159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 173/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:16.916551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:17.035950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6ac4c-2230-43d2-988b-46f365450b16 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:17.075899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:17.076563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:17.076843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:17.077109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:17.077772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:17.078068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:17.079507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:17.090497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 159/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:17.096905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:17.225971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9644347-6a26-4189-ba16-e1cef1f69005 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:17.252362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:17.271015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:17.271682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:17.271956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:17.272225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] PATH_INFO: `/v3/users/f5cef4a1a61342a9aef676db2881ab40` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:17.273397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] RBAC: Authorizing `identity:get_user(user_id=f5cef4a1a61342a9aef676db2881ab40)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:17.274841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e219-6e4d-48f7-aca5-1034f2a3fd03 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:17.276813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 174/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:17 2022] GET /identity/v3/users/f5cef4a1a61342a9aef676db2881ab40 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:17.283246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:17.341754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:17.440289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87b7ad-6d6c-4193-84ff-820c5105ab69 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:17.487861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:17.488495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:17.488730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:17.488994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:17.489722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] RBAC: Adding query filter params (role.id=d56a4f333035431eb58b79b9117ac64d, user.id=f5cef4a1a61342a9aef676db2881ab40, scope.system=all) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:17.490027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:17.491475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867e3c0-98de-434e-a42d-6c1e97e8d6af None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:17.507566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 160/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Sep 7 12:52:17 2022] GET /identity/v3/role_assignments?user.id=f5cef4a1a61342a9aef676db2881ab40&scope.system=all&role.id=d56a4f333035431eb58b79b9117ac64d => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:18.735640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f801-4689-4240-af60-a1fdf7824fae None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:18.736134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f801-4689-4240-af60-a1fdf7824fae None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:18.736237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f801-4689-4240-af60-a1fdf7824fae None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:18.737760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 175/335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:18.743398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:18.743862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:18.744038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:18.768509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:18.769813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:18.847037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 161/336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:19.125232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f801-4689-4240-af60-a1fdf7824fae None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:19.248479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f801-4689-4240-af60-a1fdf7824fae None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:19.289247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:19.289882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:19.290158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:19.290426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:19.302095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:19.307132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:19.308125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:19.308889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 176/337] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:19.315215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:19.344354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:19.435724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f33ed-2bcc-4d92-b0a5-e4076e928b86 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:19.473961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:19.474576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:19.474854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:19.475128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:19.476220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:19.476220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:19.477597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ffdd8-caf1-4abb-8f00-7bfdaf07a017 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:19.487111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 162/338] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:19.492983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:19.556738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:19.559655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8d71-2eb5-41f1-92d0-fe522810522a None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:19.559943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8d71-2eb5-41f1-92d0-fe522810522a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:19.560291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8d71-2eb5-41f1-92d0-fe522810522a None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:19.562035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 163/339] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:19.571342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:19.571961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:19.572433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:19.599754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:19.601303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:19.627901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29befd2-e82f-4591-abbb-6e5d954f6cb6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:19.687288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:19.688533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:19.689072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:19.689545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:19.724660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 164/340] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:19.803065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:19.805286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:19.863171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:19.926116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 177/341] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:19.931765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:19.948729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:20.047417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508939c-f5b4-4426-9151-a8052fe84f17 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:20.086144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:20.086786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.087057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.087319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.088472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:20.089911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8b5d4-2f91-487d-9eab-333e6ad47f20 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:20.092580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 165/342] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:19 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:20.097333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.142207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf88f9-a2f5-435a-bd82-0581d1eff189 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.142524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf88f9-a2f5-435a-bd82-0581d1eff189 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.142754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf88f9-a2f5-435a-bd82-0581d1eff189 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.144432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 166/343] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:20.149514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.149787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.150054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.176804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:20.178090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:20.275490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd0eff-4321-4118-a313-8189fc6a2332 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:20.282360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 167/344] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:20.283333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.304599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:20.348185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:20.348827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.349103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.349372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.363352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:20.364918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:20.366918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 178/345] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:20.372924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.403815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:20.446336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2b8de-cc6d-4b2f-a959-ecdca4296133 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:20.512312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:20.512944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.513218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.513483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.529827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-6e57e44c-9bc3-4633-8719-3ede9319a926 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:20.535267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:20.536211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:20.537053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:20.539056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 168/346] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:20.546472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9ff8-7246-400c-9646-d99b3e8d5499 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.548414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9ff8-7246-400c-9646-d99b3e8d5499 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.548706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb9ff8-7246-400c-9646-d99b3e8d5499 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.552604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 169/347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:20.554088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9ff8-7246-400c-9646-d99b3e8d5499 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.570048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d5930-74db-4032-b522-246ae8878188 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:20.641210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:20.642012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.642332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.642602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.643327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=281dbf41df714fa893132448a05fbc5e) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:20.643648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:20.646777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ad645-f023-4d0c-8799-94cb112ee2ef None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:20.659160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 179/348] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=d56a4f333035431eb58b79b9117ac64d => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:20.660766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.661369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.661849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.682974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:20.692094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:20.693717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:20.753114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb9ff8-7246-400c-9646-d99b3e8d5499 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:20.782487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 180/349] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:20.784148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.797810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:20.819215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:20.819919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:20.820196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:20.820446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:20.821208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:20.821507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:20.822889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:20.832621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 170/350] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:20.839801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:20.998739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d16af-7090-4625-9791-204a6b6f9011 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.006207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fac19c-1550-48e9-87b0-b2e8db809fd5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.044338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.061643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.064194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.064781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.065421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.074830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.081070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.081587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.082078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.106245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:21.113591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:21.114704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:52:21.115554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:21.122920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 181/351] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:21.139555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.245322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:21.248944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:21.301475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.348702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89848b33-dd55-44d3-bced-efa32b7ee4f0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.404413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.405910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.406879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.407300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.408328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:21.408810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:21.410475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0443-0208-4f98-8f61-f39b97611cb9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:21.410610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 171/352] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:21.411406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.423538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 182/353] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:21.429498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d2f5-2336-4de5-b3ed-fefa18ee5130 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.429498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d2f5-2336-4de5-b3ed-fefa18ee5130 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.429498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137d2f5-2336-4de5-b3ed-fefa18ee5130 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.430356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 183/354] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:21.431091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137d2f5-2336-4de5-b3ed-fefa18ee5130 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.459747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.554817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce485cc-c40e-428d-9f50-8345f241b26c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.572988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137d2f5-2336-4de5-b3ed-fefa18ee5130 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.608200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.608841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.609117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.610074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.612249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.618208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.619284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.619600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.620013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.621510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:21.621622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:21.623104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:21.627698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 184/355] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-c869d2d1-4d7f-49fa-8f57-2686eec534b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:21.627986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:21.628911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:21.629748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 172/356] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:21.630407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688d5e-8099-47b5-acca-3b9816fc748a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.630479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688d5e-8099-47b5-acca-3b9816fc748a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.630769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688d5e-8099-47b5-acca-3b9816fc748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.631611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.650936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cc688d5e-8099-47b5-acca-3b9816fc748a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:21.652150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cc688d5e-8099-47b5-acca-3b9816fc748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:21.743056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 173/357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:21.745427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92dd58-172d-447f-babf-4c5a00bd544d None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.745875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92dd58-172d-447f-babf-4c5a00bd544d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.746536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92dd58-172d-447f-babf-4c5a00bd544d None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.748686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 174/358] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:21.749767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92dd58-172d-447f-babf-4c5a00bd544d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.754284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bca836-ae11-4647-9ca1-c79882af6053 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.784053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.801151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.802125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.802547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.804083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] PATH_INFO: `/v3/users/4d1f149c9e6244049d5d07249a53a2c1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.805602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] RBAC: Authorizing `identity:get_user(user_id=4d1f149c9e6244049d5d07249a53a2c1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:21.807205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:21.809200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 185/359] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/users/4d1f149c9e6244049d5d07249a53a2c1 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:21.811147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:21.896694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92dd58-172d-447f-babf-4c5a00bd544d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.915703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:21.945005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:21.946082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.946592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.947075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.948426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:21.950112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb48a41-5a59-40c2-b924-f438d4284b40 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:21.954327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 175/360] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:21.955952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:21.956439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:21.956921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:21.970256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d20d1-f05a-48df-b4e8-d26a5a40c848 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:21.984166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:21.987743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:22.010249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.011561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.012040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.012525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.013394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:22.013905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:22.015502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:22.025167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 186/361] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:22.026263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.080852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 176/362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:22.083778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.119208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.155516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c39fde-57f6-4355-b5d8-19ee89dbe0ac None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.189575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.199440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.200221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.200591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.200955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.201774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] RBAC: Adding query filter params (role.id=e5723533747d4566b5e168d4b16e0567, user.id=4d1f149c9e6244049d5d07249a53a2c1, scope.system=all) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:22.202274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:22.204030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:22.219993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 187/363] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/role_assignments?user.id=4d1f149c9e6244049d5d07249a53a2c1&scope.system=all&role.id=e5723533747d4566b5e168d4b16e0567 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:22.221195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.229156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebdfa4-2bb6-40f6-a6ea-c85c4eb3a879 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.276808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.279040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.282399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.283053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.284020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=281dbf41df714fa893132448a05fbc5e) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:22.284570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:22.286183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:22.302758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 177/364] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:22.304585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.418750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e627cb-1faa-4fd3-9191-cc115915378f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.473930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.474806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.475242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.475674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.505487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.538050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348847-8e5e-4702-ba74-8a8b9a93d6fe None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.557346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.574131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:22.575969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:22.589945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.590596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.590872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.591142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.608924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:22.615553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:22.616479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:22.617307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 178/365] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:22.617956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.739387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 188/366] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:22.740564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.753102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04293fea-b157-43d2-9441-60f53a9dad7e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.799395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.800087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.800363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.800635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.813479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:22.825451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:22.826575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 179/367] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:22.827550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.833078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.842949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:22.861663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499b42c-a851-4b52-a670-6dd5a6d41680 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:22.904897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:22.905505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:22.905778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:22.906038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:22.906929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:22.907513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:22.909914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:22.925354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 189/368] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:22.926569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:22.969647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a201-4c72-42f8-b1de-a554de364fc6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.022183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.023173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.023703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.024182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.025597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.027427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.029474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 180/369] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:23.030533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.059746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59a98-f283-4a9f-b2a0-c20df5b68e70 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.105154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.106403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.107393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.107930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.108917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:23.110108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.111947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.121938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.123206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 190/370] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:23.125406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.140038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.163635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10341-8595-4be9-898b-7e51c8ed5868 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.209666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.210299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.210572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.210837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.264391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434d579-88a3-4114-940c-b05547d3955b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.313503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.315122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.316420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.316719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.316993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.317520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.318373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.319968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.322220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 191/371] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:23.322778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.412604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.430413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.448383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 181/372] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:23.449282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.470313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d77f05-efa9-4a24-a368-22b03d31e3a6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.521439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.522240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.522717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.530272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.580027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bab7-4342-474c-bbf7-084c0deb856f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.614812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.616300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5cba7-096e-4347-b0e5-06c97f59e76a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.630083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.630810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.631086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.631480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.632244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:23.632548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.634074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.647579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 182/373] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=d56a4f333035431eb58b79b9117ac64d => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:23.649311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.707259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.714805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:23.750048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 192/374] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:23.750048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48febaf-3205-4cca-aeef-8db3e83d9092 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.750048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48febaf-3205-4cca-aeef-8db3e83d9092 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.750048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48febaf-3205-4cca-aeef-8db3e83d9092 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.750525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 193/375] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:23.764475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.764905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.765279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.789367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:23.790660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:23.805610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a1a3c-3e6f-4a10-ad76-962480d88e1e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:23.856325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:23.858332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:23.860128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:23.860941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:23.863038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:23.865345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:23.867985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 183/376] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:23.869443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:23.887093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 194/377] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:23.890232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.001089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b06d1-58c3-4339-9d52-e8619c9842cd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.011139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.043503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.043503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.043503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.043503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.043919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.043919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.044409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 195/378] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:24.054317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.063330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e961492-c149-4a4c-884e-423bd072151e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.071943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.135399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.137912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.138736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.139517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] PATH_INFO: `/v3/projects/6357086c38f94b52a4634cd4a7e2bbea` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.143763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=6357086c38f94b52a4634cd4a7e2bbea)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.145938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.151651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 184/379] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:23 2022] GET /identity/v3/projects/6357086c38f94b52a4634cd4a7e2bbea => generated 344 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:24.157707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.258306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b476e6-1b0b-4610-bcce-3f1d50ed5430 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.327809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.329544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.330070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.330559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.332589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:24.333113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.336225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.349517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 196/380] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:24.351777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e917ab-b5c2-427d-8a84-df0a0fdfd0b9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.373505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.397726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.398795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.399323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.401070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] PATH_INFO: `/v3/groups/989774046c0d4768a05ce4bb7623ed49` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.408647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] RBAC: Authorizing `identity:get_group(group_id=989774046c0d4768a05ce4bb7623ed49)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.410699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.413220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 185/381] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/groups/989774046c0d4768a05ce4bb7623ed49 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:24.419947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.427598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.506066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.534311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a2372-f492-4912-b4a9-5b4fcad46905 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.582025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.582791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.582993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52edfbb-84ac-4aea-888d-9f4aad5ff727 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.583140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.583817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.604689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:24.613132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:24.614044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:24.614817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:24.617763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 197/382] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:24.624461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.639773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.640563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.640920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.641208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.642041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] RBAC: Adding query filter params (group.id=989774046c0d4768a05ce4bb7623ed49, role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=6357086c38f94b52a4634cd4a7e2bbea) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:24.642446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.644126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.650694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 186/383] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/role_assignments?group.id=989774046c0d4768a05ce4bb7623ed49&scope.project.id=6357086c38f94b52a4634cd4a7e2bbea&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:24.787150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.791003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c0330-95f1-44ca-9cf8-15086d895ac1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:24.841682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:24.842321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:24.842601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:24.842873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:24.843597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:24.843941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:24.845544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:24.858476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 198/384] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:24.864362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:24.977961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:24.980255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868cfbc-d222-4f48-a799-2df08be548ea None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:25.018023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:25.018650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:25.018926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:25.019188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:25.020320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:25.021755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:25.023683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 187/385] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:24 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:25.029230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:25.189228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821059aa-e135-4f30-9659-48ae42358c36 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:25.232997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:25.233557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:25.233834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:25.234107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:25.235353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:25.236820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3698ad-55e2-4c89-bbee-911cdb84a2fa None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:25.238618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 199/386] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:25 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:25.245268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:25.321814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a534e-3656-4f98-aaf1-8f607af486d1 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:25.322321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a534e-3656-4f98-aaf1-8f607af486d1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:25.322394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a534e-3656-4f98-aaf1-8f607af486d1 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:25.323953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 200/387] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:25.341180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:25.341471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:25.341741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:25.374655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f462af-ba11-40ef-8e9f-80baa4baadca None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:25.376978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:25.378193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:25.414791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:25.415879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:25.416370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:25.416831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:25.419032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, group_id=a0de4143d52f48a3a6d1d1cbb24a9783, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:25.421712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:25.431832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:25.445579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 188/388] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Sep 7 12:52:25 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:25.495993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 201/389] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:25.983173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:26.015630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:26.101425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c3aa-7641-4a3f-b61e-11b631589c93 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:26.139750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:26.141473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.142069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.142539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.153927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:26.160034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:26.161005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:26.161807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:26.164348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 189/390] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:26.169858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:26.308111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be85cc3-40b6-4985-bab2-eb656ca47802 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:26.344694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:26.345321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.345569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.345835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.346502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:26.346862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:26.348327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eceece-d227-4673-b804-7ccf9b820307 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:26.358371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 202/391] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:26.364629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:26.483282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6bbe9-0794-4897-b49e-043aaca1a9ac None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.483743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6bbe9-0794-4897-b49e-043aaca1a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.483847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6bbe9-0794-4897-b49e-043aaca1a9ac None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.487592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 203/392] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:26.496929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.497185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.497406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.510004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7b072-bdd4-4772-bd77-a54807fd3266 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:26.512972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:26.527835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:26.529026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:26.548918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:26.549554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.549833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.550105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.553912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:26.555354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:26.557378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 190/393] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:26 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:26.557594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:26.573324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:26.613484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 204/394] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:26.710831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16bbd2-3ffa-4e9f-b4bd-221dcf1d9a7c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:26.754759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:26.755396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.755698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.755968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.760163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:26.761659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:26.763597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 191/395] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:26 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:26.769963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:26.897243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79a61-9e81-416d-948f-02b290aae05d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:26.946433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:26.947145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:26.947423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:26.947746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:26.952169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] RBAC: Authorizing `identity:create_grant(project_id=281dbf41df714fa893132448a05fbc5e, group_id=a0de4143d52f48a3a6d1d1cbb24a9783, role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:26.953653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:26.970783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 205/396] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Sep 7 12:52:26 2022] PUT /identity/v3/projects/281dbf41df714fa893132448a05fbc5e/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:27.030076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.064645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:27.163335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197977ef-57bc-45ed-9164-ea36f9302fec None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:27.207446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:27.208583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.209097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.209595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.227419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ac17eb22-6490-484a-8e86-66a880d930c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:27.233494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:27.234654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:27.235431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:27.238875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 192/397] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:27.245110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.268855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:27.343500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066a6d-9e0a-4288-b16c-ade854050772 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.344529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066a6d-9e0a-4288-b16c-ade854050772 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.344808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066a6d-9e0a-4288-b16c-ade854050772 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.347067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 193/398] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:27.352493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.352772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.353045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.373891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:27.375887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:27.443121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c467e7-de6c-43fb-a4a5-b924f9479ad7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:27.506343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 194/399] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:27.508372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:27.508997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.509270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.509597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.510265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:27.510613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:27.512126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9684b-bf87-4e8b-9490-7bab768b3fd4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:27.534636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 206/400] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:27.540315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.556058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:27.659770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ba47-7bd5-4b12-87c6-8169810826cf None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:27.710928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:27.711945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.712445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.712933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.714848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:27.715037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2246-1fde-4b88-94d2-94b400178d5b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.715293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2246-1fde-4b88-94d2-94b400178d5b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.715615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2246-1fde-4b88-94d2-94b400178d5b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.717129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265def69-044c-4da6-bb9a-ee85ba29787b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:27.717238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 207/401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:27.720161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 195/402] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:27.726805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2246-1fde-4b88-94d2-94b400178d5b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.727491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.727996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.728467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.753023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:27.754235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:27.861739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 196/403] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:27.862440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:27.862577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:27.891892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:27.914994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2246-1fde-4b88-94d2-94b400178d5b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:27.987199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:27.987770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:27.988052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:27.988323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:27.990746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:27.992646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:27.994651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 208/404] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.000653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.033087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97eba5-4425-4eb4-9b1e-8496223eacc9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.099715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.100244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.100525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.100795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.128433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:28.133622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:28.134493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:28.135269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:28.140315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 197/405] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:28.148424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.163531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7134558-83a9-4022-8445-5e8eca70af49 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.202567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.203371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.204447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.204447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.207139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, group_id=a0de4143d52f48a3a6d1d1cbb24a9783, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.209450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.235711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 209/406] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Sep 7 12:52:27 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:52:28.235711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.259966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:28.306740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:28.364756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37aece-3fcf-4236-a899-8c20334d7135 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.402945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.403652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.403872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.404144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.404823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:28.405123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.407065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad104-7447-419e-8016-4f8c4363fe9d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.414273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a85672-fc50-402b-a28d-6d3b79d3c8b6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.416950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 198/407] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.423910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd9b1-3a5e-47be-9281-863b76d46cb3 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.424204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd9b1-3a5e-47be-9281-863b76d46cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.424468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd9b1-3a5e-47be-9281-863b76d46cb3 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.426129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 199/408] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:28.426676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dd9b1-3a5e-47be-9281-863b76d46cb3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.465348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.471485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.471485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.471485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.485224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-728abf7c-bac6-4d7f-ab7b-dc026565e3d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:28.493077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:28.493957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:28.494745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:28.496024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 210/409] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:28.497240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.497510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.499400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.528674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:28.530858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:28.574505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dd9b1-3a5e-47be-9281-863b76d46cb3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.613970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:28.615546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.616259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.616683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.617729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.618264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.619860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.621919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 200/410] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.626684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.630505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:28.638125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 211/411] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:28.638800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.754603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9f923-8e0c-4965-b651-3f89e07a38de None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.792908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.793836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.794332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.794803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.795718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:28.796226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.798523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.809534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 201/412] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.820717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.850803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a41d-f59c-4487-8dcd-21bb56534fbc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.885572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.886202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.886489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.886765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.887877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.889298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.891073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 212/413] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.896957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:28.916575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:28.942961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694696e3-222b-4a74-a354-b8142a9576a3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:28.980942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:28.981946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:28.982451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:28.982923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] PATH_INFO: `/v3/groups/989774046c0d4768a05ce4bb7623ed49` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:28.985082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] RBAC: Authorizing `identity:get_group(group_id=989774046c0d4768a05ce4bb7623ed49)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:28.986858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:28.988848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 202/414] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/groups/989774046c0d4768a05ce4bb7623ed49 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:28.989826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:29.021297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.065864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5dd2a-76a9-446f-8a2b-7d5607d1e662 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.100901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139cbe8-8991-4f5b-ba2b-b1fa8015a8da None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.101446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.102206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.102580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.102952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.105417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb, group_id=a0de4143d52f48a3a6d1d1cbb24a9783, role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:29.107005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:29.123420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 213/415] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Sep 7 12:52:28 2022] PUT /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb/groups/a0de4143d52f48a3a6d1d1cbb24a9783/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:52:29.124530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:29.142971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.155789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.157062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.157349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.157617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.181345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:29.186742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:29.187962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:29.188926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:29.196290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 203/416] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:29.202108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:29.244658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84c3e7-b627-4663-a2cd-01890799503f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.267045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.287594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.288798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.289097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.289384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] PATH_INFO: `/v3/projects/6357086c38f94b52a4634cd4a7e2bbea` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.292467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] RBAC: Authorizing `identity:get_project(project_id=6357086c38f94b52a4634cd4a7e2bbea)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:29.295240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:29.298244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 214/417] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:29 2022] GET /identity/v3/projects/6357086c38f94b52a4634cd4a7e2bbea => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:29.305103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:29.409707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd82d2f-5345-405d-ae89-eb88b10d3696 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.418164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf806f2-1174-471a-b514-27c5d1372fab None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.469378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.470250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.470594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.470797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] PATH_INFO: `/v3/projects/6357086c38f94b52a4634cd4a7e2bbea/groups/989774046c0d4768a05ce4bb7623ed49/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.473133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] RBAC: Authorizing `identity:create_grant(project_id=6357086c38f94b52a4634cd4a7e2bbea, group_id=989774046c0d4768a05ce4bb7623ed49, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:29.473915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.474520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.474687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbd8d-5399-44ff-8997-4d852b32a295 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:29.474786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.475052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.475750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] RBAC: Adding query filter params (name=member) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:29.476053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:29.477400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:29.489460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 204/418] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:29.495748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 215/419] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Sep 7 12:52:29 2022] PUT /identity/v3/projects/6357086c38f94b52a4634cd4a7e2bbea/groups/989774046c0d4768a05ce4bb7623ed49/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:29.496600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:29.574644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.657001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e4117-bc67-4729-a162-6d2566461692 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:29.706479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:29.707005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.707282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.707593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.784511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:29.786106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:29.821019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68005-69c8-4d9b-90aa-33de8a94f15d None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.821450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68005-69c8-4d9b-90aa-33de8a94f15d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.821800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a68005-69c8-4d9b-90aa-33de8a94f15d None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.823361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 216/420] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:29.828965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:29.829329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:29.829807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:29.852289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:29.853740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:29.873545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.921756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:29.939424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:29.978185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 205/422] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:29.983895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.119172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c623e42-b9ac-46d8-909a-f265f38a8579 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:30.159620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:30.160639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.161100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.161555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.163409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:30.165973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:30.169246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 218/423] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:29 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:30.176853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.314276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.338431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c96167-d295-4bec-ab20-6814b08312e8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:30.395855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:30.405754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:30.406562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.406871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.407107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.408405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:30.409851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:30.414308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 206/424] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:30 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:30.423578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.468283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460938e-32c5-4673-9e6b-f6a8cad7216f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:30.482667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:30.528147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:30.528794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.529070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.529340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.551321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:30.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:30.558484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:30.559261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 219/425] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:30.566986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.644848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f722a0-1739-4b7f-93e8-3b078b5b30cf None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:30.707670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:30.708311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.708590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.708862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.709630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=281dbf41df714fa893132448a05fbc5e) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:30.709942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:30.711422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371919-4fc3-497e-aa39-f4542bb50d5c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:30.735997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 207/426] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:30 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=d56a4f333035431eb58b79b9117ac64d => generated 611 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:30.768297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc7d53-485e-4235-acbd-9b56d8d0541f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:30.776090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:30.824239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:30.824791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.825077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.825357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.826043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:30.826420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:30.827903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:30.828128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a288-a015-4ea8-b168-c717987782fb None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.828347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a288-a015-4ea8-b168-c717987782fb None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.828728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a288-a015-4ea8-b168-c717987782fb None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.834230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 208/427] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:30.836726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:30.837010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:30.837277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:30.847137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 220/428] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:30.852560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:30.857370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:30.858612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:30.995717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 209/429] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:31.035299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fadf-09f2-4c71-90df-0fe29dafa682 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.074848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.075379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.075684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.075953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.114544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.154000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.155483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.264757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 221/430] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:31.270814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.292205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.343886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.390305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a263a-ac0b-4b27-b6f5-87493a1470a9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.423216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.439031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.440160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.440441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.440712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] PATH_INFO: `/v3/projects/281dbf41df714fa893132448a05fbc5e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.442193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] RBAC: Authorizing `identity:get_project(project_id=281dbf41df714fa893132448a05fbc5e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.444467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.447435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 210/431] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/projects/281dbf41df714fa893132448a05fbc5e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:31.452590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.457181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62fe89-5da8-42e0-a124-7a6c45837a39 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.495689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.496354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.496633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.496902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.513449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:31.519880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:31.520859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:31.521655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 222/432] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:31.526785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.602164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.624280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78533e03-0137-47a1-92ca-086d5613bd31 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.669107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.669792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.670074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.670386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.671596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.672076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa602f5e-82cd-453f-836c-569a6736844a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.673514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.675422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 211/433] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:31.684535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.708903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.718378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.720362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.721093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.721093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.722232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] RBAC: Adding query filter params (name=member) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:31.722518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.724559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.739763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 223/434] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:31.741055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:31.805806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1666a8-5d8a-4c5d-ad21-c8a07c9d122a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.845333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.846210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.846626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.847031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.847772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045fe26-5889-4bdc-a703-9c47f1e67335 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:31.848107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=281dbf41df714fa893132448a05fbc5e) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:31.848564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.850328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b4a4e-58e1-4580-9807-f1bbda61c9a7 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:31.857015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 212/435] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=281dbf41df714fa893132448a05fbc5e&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:31.885482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:31.886110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:31.886385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:31.886652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:31.956709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:31.969608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:31.971302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:32.072573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c0ae-ee4d-48b4-9b26-3df6575aa37a None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.072913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c0ae-ee4d-48b4-9b26-3df6575aa37a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.073123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c0ae-ee4d-48b4-9b26-3df6575aa37a None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.074586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 213/436] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:32.081039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356664-fd04-4832-885a-f4debaeb7b01 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.081320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356664-fd04-4832-885a-f4debaeb7b01 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.081585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356664-fd04-4832-885a-f4debaeb7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.092988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 224/437] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:32.099317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.106358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e6356664-fd04-4832-885a-f4debaeb7b01 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:32.107725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e6356664-fd04-4832-885a-f4debaeb7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:32.123305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.211945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 214/438] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:32.221760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.232993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1761-a773-4be2-b50f-6b8008990b60 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.274176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ec70-5c36-40e6-9202-8f14e8969068 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.274392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.274488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ec70-5c36-40e6-9202-8f14e8969068 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.274716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2ec70-5c36-40e6-9202-8f14e8969068 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.274873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.275152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.275431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.276344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 215/439] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:32.276611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:32.278082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:32.279744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 225/440] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:32.281756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.282041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.282321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.285581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.304965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:32.307035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:32.392722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 216/441] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:32.415988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753035e-e123-4872-9424-acc3a39d3f03 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.450940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.451600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.451874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.452139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.453932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:32.455309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:32.461721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 226/442] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:32.462870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.491628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.526823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.548646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.577430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4a7ab-acc8-41ee-bc41-3d1ec64f26f7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.604442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b620-9145-4543-97ac-5b42f3fad004 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.616175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.616768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.617042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.617409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.618247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=d56a4f333035431eb58b79b9117ac64d, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:32.618545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:32.620103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:32.626940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 217/443] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=d56a4f333035431eb58b79b9117ac64d => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:32.638950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.639941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.640122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.640992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.653194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:32.659329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:32.660306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:52:32.661094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:32.664419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 227/444] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:32.665146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.666423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.768154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.781063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010851bb-0032-4084-868a-bc404871ef0f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.787131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13087b-ceee-4923-8f2c-2dfd1802deeb None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.819833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.820497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.820776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.821049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.831196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:32.831730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:32.831854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:32.832102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:32.832378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:32.833049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:32.833350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:32.834781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:32.835041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:32.840844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:32.841726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:32.842525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 218/445] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:32.847491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 228/446] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:32.850884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.851170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:32.972722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d738e9-a295-4e4d-81f8-36021ce3fe13 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:32.976945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44abc9-5925-4a93-92f6-9a1751bb66e6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.016463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.017091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.017372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.017644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.018314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:33.018477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.018663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.019136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.019421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.019739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.020142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.029247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 219/447] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:33.035362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.039553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.092096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.094125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.097423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.136133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1de7c1-f04c-447f-8ab5-acf5de770ac0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.168645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.169239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.169512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.169778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.194645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 229/448] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:33.200154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.238910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.240376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.248985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.300878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.301081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b4e38-2740-4e7f-a536-61c3a754d87f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.336513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.337136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.337415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.337684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] PATH_INFO: `/v3/projects/6357086c38f94b52a4634cd4a7e2bbea` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.338804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] RBAC: Authorizing `identity:get_project(project_id=6357086c38f94b52a4634cd4a7e2bbea)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.340281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.341358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 220/449] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:33.345301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 230/450] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/projects/6357086c38f94b52a4634cd4a7e2bbea => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:33.347349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.347507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.448880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a54dd-8547-4df8-81f9-11cb59e30c6c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.449693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb92d0-1eae-47d8-9479-025e94cd1f36 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.465572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.483733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.484466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.484588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.485105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.485105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] PATH_INFO: `/v3/groups/989774046c0d4768a05ce4bb7623ed49` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.485324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.485607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.485882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] PATH_INFO: `/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.486117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] RBAC: Authorizing `identity:get_group(group_id=989774046c0d4768a05ce4bb7623ed49)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.487015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] RBAC: Authorizing `identity:get_project(project_id=3b0c654e6f544c3c8a6475ef8a4b59bb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.487601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.488446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.489309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 231/451] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/groups/989774046c0d4768a05ce4bb7623ed49 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:33.490151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 221/452] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/projects/3b0c654e6f544c3c8a6475ef8a4b59bb => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:33.494972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.495189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.527380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.598940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df46f0-c92c-499a-aeb9-9efa83564615 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.599137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482482-7afb-4f99-a353-f4dc8f757561 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.632374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.632969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.633214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.633351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.633495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.633826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.634100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.634185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] RBAC: Adding query filter params (group.id=989774046c0d4768a05ce4bb7623ed49, role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=6357086c38f94b52a4634cd4a7e2bbea) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:33.634366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] PATH_INFO: `/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.634487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.635471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] RBAC: Authorizing `identity:get_group(group_id=a0de4143d52f48a3a6d1d1cbb24a9783)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.635940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cc1aa-0491-4812-bb69-b9bd336010e5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.636870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.638579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 222/453] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/groups/a0de4143d52f48a3a6d1d1cbb24a9783 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:33.647513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 232/454] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/role_assignments?group.id=989774046c0d4768a05ce4bb7623ed49&scope.project.id=6357086c38f94b52a4634cd4a7e2bbea&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:33.647700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:33.755318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:33.759760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ebc5f-1015-43ae-901d-5bda34ba017e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:33.797406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:33.798209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:33.798485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:33.798754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:33.799511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] RBAC: Adding query filter params (group.id=a0de4143d52f48a3a6d1d1cbb24a9783, role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:33.799826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:33.801285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99674a4-aab8-4599-b07f-e1a99db223d0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:33.808357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 223/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Sep 7 12:52:33 2022] GET /identity/v3/role_assignments?group.id=a0de4143d52f48a3a6d1d1cbb24a9783&scope.project.id=3b0c654e6f544c3c8a6475ef8a4b59bb&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:36.623159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29b9dc-046f-422c-b08f-d8b647513665 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:36.624018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29b9dc-046f-422c-b08f-d8b647513665 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:36.624430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29b9dc-046f-422c-b08f-d8b647513665 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:36.626674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 233/456] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:36.632432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:36.632911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:36.633160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:36.657366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:36.658886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:36.714248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fb83-78ad-4141-bd70-e47ff4da361b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:36.714578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fb83-78ad-4141-bd70-e47ff4da361b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:36.714788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fb83-78ad-4141-bd70-e47ff4da361b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:36.716404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 234/457] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:36.722252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39363c97-5ecc-457f-8ae8-3d4bbd24b7c2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:36.722536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39363c97-5ecc-457f-8ae8-3d4bbd24b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:36.722792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39363c97-5ecc-457f-8ae8-3d4bbd24b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:36.752316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-39363c97-5ecc-457f-8ae8-3d4bbd24b7c2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:36.756634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-39363c97-5ecc-457f-8ae8-3d4bbd24b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:36.773056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 224/458] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:36.815851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:36.838856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 235/459] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:37.096527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.229853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:37.240633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a57f6a-64c1-4988-ae92-477ea173629a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.267977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4480-d221-4d9f-88ae-6bc9b8fe6503 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.268587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4480-d221-4d9f-88ae-6bc9b8fe6503 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.269097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a4480-d221-4d9f-88ae-6bc9b8fe6503 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.270803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 236/460] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:37.276958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46822-1c5f-44d3-bfef-4fc22f286204 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.277330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46822-1c5f-44d3-bfef-4fc22f286204 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.277666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46822-1c5f-44d3-bfef-4fc22f286204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.296400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:37.298444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.298900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.299336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.304271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-98a46822-1c5f-44d3-bfef-4fc22f286204 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:37.305555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-98a46822-1c5f-44d3-bfef-4fc22f286204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:37.314507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:37.316650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:37.333441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:37.334412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:37.335941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:37.335941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:37.335941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:37.335941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 225/461] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:37.335941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.388796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 237/462] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:37.397077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c63f-97a3-41ad-9e23-49699e41b8ec None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.397435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c63f-97a3-41ad-9e23-49699e41b8ec None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.397771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c63f-97a3-41ad-9e23-49699e41b8ec None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.399693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 238/463] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:37.404262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358c63f-97a3-41ad-9e23-49699e41b8ec None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.454019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720c27f-2a19-49e5-8704-2f280c08e36f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.490486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:37.491266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.491627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.491965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.504114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:37.505799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:37.508507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-bf380fc5-ff1d-426e-aefa-b021e8fdf600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:37.528815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:37.529792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 226/464] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.530661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.536219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358c63f-97a3-41ad-9e23-49699e41b8ec None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.548060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:37.553437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:37.554893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:37.576591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:37.577283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.577640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.578242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.579044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:37.579422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:37.581079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:37.593926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 239/465] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:37.594928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.633821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 227/466] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:37.635435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.711561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ce7d-8374-4436-b0e2-3450948b4d6a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.742265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8607a9-94c8-44da-bd5e-8140fc3c37cf None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.749030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:37.750426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.750947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.751364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.752282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:37.752722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:37.754391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:37.767629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 240/467] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:37.768799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.772151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:37.782344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:37.783139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:37.783626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:37.783991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:37.784732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:37.786421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:37.802000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:37.815199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 228/468] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:37 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:37.816465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:37.956526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56decb-72ea-41dc-b702-7bf96c718580 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:37.999738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da4886-d11e-4796-9531-c5cbe19450bd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.008462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.010069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.010575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.011048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.025138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.027657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.045584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.046574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.047613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.048033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:38.048350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:38.049412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:38.050258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:38.050258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:38.050258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:38.050432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 241/469] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:38.051424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.051569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.053228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.082372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 229/470] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:37 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:38.083098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.143305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:38.162204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:38.195116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c33f5-5f85-4a5c-b8ae-9a71ca424df9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.235085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a244de-ec11-48c1-a17e-fd928135cdc4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.242901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.243672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.244680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.245050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.261743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.263609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.279811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.280537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.280924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.281264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.282189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:38.282640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.284129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718297d0-62b0-4bdd-87b0-5d99424b289f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c76426fb-4ca4-4152-b5bf-5668820c26e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:38.285444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:38.286517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:38.287444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:38.287444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:38.287444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:38.289394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 242/471] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:38.290865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ed0-cf99-41db-8662-d548c4c7006c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.291286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ed0-cf99-41db-8662-d548c4c7006c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.291761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69ed0-cf99-41db-8662-d548c4c7006c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.293499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 243/472] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:38.299409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69ed0-cf99-41db-8662-d548c4c7006c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.306283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 230/473] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:38.307436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.307744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.308020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.328219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:38.329475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:38.417710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 231/474] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:38.418442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.432598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69ed0-cf99-41db-8662-d548c4c7006c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.458496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:38.475557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:38.482346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.482967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.483590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.483971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.484774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:38.485225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.486697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.503602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 244/475] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:38.511514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.555704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20881-121a-40ff-b8b1-19755b77a6ce None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.596532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.597538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.598071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.598484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.599329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.601088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.635277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 232/476] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:38 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:38.637648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c3bec-b161-4a19-85ca-a060a9e3e82d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:38.676477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:38.677155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:38.677483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:38.677759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:38.678411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:38.679898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:38.705099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 245/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:38 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:52:38.876028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:38.975988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:39.000329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b58f6-3563-4d4c-b603-b063b080319c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:39.040670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:39.041637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.042109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.042572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.043490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:39.045048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:39.060259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.sql.core [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:52:39.060259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:52:39.060259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [parameters: {'id': '309ed1c55e894157b39e90e688c9e297', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:52:39.060259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81487) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result.read() Sep 07 12:52:39.081556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:52:39.082461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application yield resource Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise self.value Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application session.commit() Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:52:39.083426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:52:39.084289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:52:39.085166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result.read() Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:52:39.087289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [parameters: {'id': '309ed1c55e894157b39e90e688c9e297', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:39.089259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:52:39.091313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:39.095740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 233/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Sep 7 12:52:38 2022] POST /identity/v3/roles => generated 144 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:39.101242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:39.159241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:39.218136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3729ff-4b9f-4892-a59c-c01c0f32c8c0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:39.256633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:39.257323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.257609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.257880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.271190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-767bada6-9dc1-4289-8beb-eb643544209f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:39.277252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:39.278181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:39.279404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 246/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:52:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:39.285819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:39.396061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3998-2287-4146-b887-93a37615bc4b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:39.431553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:39.432195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:39.432474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:39.432744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:39.433408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:39.433708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:39.435065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a778f9-bc4e-4998-8986-14319482bd12 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:39.444533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 234/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:40.715625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398370-01d8-4ec8-b01b-90f3da385ab2 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.716142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398370-01d8-4ec8-b01b-90f3da385ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.716142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398370-01d8-4ec8-b01b-90f3da385ab2 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.717761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 247/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:40.723732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.724163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.724335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.748450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:40.750248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:40.753257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:40.814048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48da8-18ff-41e2-9fb6-f3a0bd4a644e None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.814321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48da8-18ff-41e2-9fb6-f3a0bd4a644e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.814527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a48da8-18ff-41e2-9fb6-f3a0bd4a644e None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.816177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 248/482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:40.822456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:40.822871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:40.823239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:40.843819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 235/483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:40.850104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:40.851484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:40.950007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 249/484] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:41.310597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.326331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.392291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.454463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574107a2-a47d-4135-a4d1-8225eb7b6382 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.493523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.494545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.495221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.496040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.511698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:41.520464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:41.521403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:41.522750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:41.525411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 250/485] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:41.533438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.551923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4259ed-fbde-406f-8df3-0d19ab270497 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.636570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.637240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.637508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.637777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.647272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.650527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:41.651568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.655621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731647-c745-43bc-8da6-b23dd042d0c6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b49b6650-49b8-4000-81c4-4d5d395215a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:41.657108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:41.657976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:41.658745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:41.663244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 236/486] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:41.664674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bc337-8bb3-45a4-8eb7-1b22aa397f42 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.664961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bc337-8bb3-45a4-8eb7-1b22aa397f42 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.665241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bc337-8bb3-45a4-8eb7-1b22aa397f42 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.672201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 237/487] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:41.673389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bc337-8bb3-45a4-8eb7-1b22aa397f42 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.706301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.706908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.707182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.707450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.708138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:41.708546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.709824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c53399-989d-4bbe-9891-e81b664d2aa3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.724372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 251/488] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:41.725788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.726079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.726354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.746622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:41.747938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:41.799271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bc337-8bb3-45a4-8eb7-1b22aa397f42 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.821567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 252/489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:41.832390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.837949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:41.838793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.839299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.839792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.840648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:41.841124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:41.842744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9effc3-c7d6-46b3-9083-7a2105d0d17d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:41.854793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 238/490] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:41.857590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29cad-d0bc-4c11-b922-ae1afe831f1b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:41.858477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29cad-d0bc-4c11-b922-ae1afe831f1b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:41.860236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd29cad-d0bc-4c11-b922-ae1afe831f1b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:41.867489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 239/491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:41.868667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd29cad-d0bc-4c11-b922-ae1afe831f1b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:41.938917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.953705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:41.965306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4ea1-9de6-4cb9-8a67-2f351759c87a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:41.999439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd29cad-d0bc-4c11-b922-ae1afe831f1b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.004193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.005120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.005668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.006155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.018155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.020266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6106a823-206e-4c1e-9e57-12f769c204a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:42.037434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.038431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:42.039302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:42.039302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:42.039302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:42.041356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.041897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 253/492] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.042011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.042265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.042598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.043976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.044478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.044943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.059527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.060998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.070584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:42.072087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:42.081024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.081990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:42.082827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:42.082827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:42.082827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:42.084911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 240/493] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.085976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.159495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 254/494] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:42.159495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.209524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552cf91-2655-4e4f-8d83-2729b119eefe None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.224160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.229044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.245358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.245961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.246236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.246501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.247130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.247429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.248802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.266897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 241/495] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.268080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.274279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ef8b5-e8a1-4dea-a127-9906f4d71883 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.314524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.315232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.315619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.315954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.316751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.317111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.318800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab04ad7-f936-47e1-92d1-0ad7b55d792a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.331881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 255/496] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.332962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0484f-d34d-4033-84a5-bee3f0278a7c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.333243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0484f-d34d-4033-84a5-bee3f0278a7c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.333508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0484f-d34d-4033-84a5-bee3f0278a7c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.338822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 256/497] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:42.338822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0484f-d34d-4033-84a5-bee3f0278a7c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.393246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ef56-2c78-4828-8c20-b9d7f04ae674 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.429815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.430435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.430705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.430970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.441209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:42.446169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.447061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:42.447900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 242/498] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.448568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.452467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0484f-d34d-4033-84a5-bee3f0278a7c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.482468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.482850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.489164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.489797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.490075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.490349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.497463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.498912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-63245b8b-10ca-4b3d-b3b6-c8e63d044938 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:42.511938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.513008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:42.513934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 257/499] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.514490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.514758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.515005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.534087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:42.535290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:42.558489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94109fc-8f82-4484-832d-d25c91ab5815 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.593685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.594304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.594582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.594850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] PATH_INFO: `/v3/users/nova` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.601945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.602073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 258/500] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:42.602804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.603446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:42.616489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.617408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:42.618271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:42.619613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 243/501] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.619932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.715680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45101a-6f5d-4d19-a4d6-1b50f330242b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.724659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.732791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b038b-d4f8-4a5d-9086-1c17a3eac7be None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.739735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:42.752581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.753194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.753471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.753738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.763989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:42.769634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:42.770510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:42.771281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 259/502] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:42.771944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.776118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.776737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.777019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.777290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.777953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.778252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.779644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.793043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 244/503] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.793043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.884991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ee32-0aab-41ae-a402-4a60e2ff07f6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.890977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd4131-4f05-4c66-b1e7-8d00d7b8c4da None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:42.919552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.920165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.920436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.920701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.921965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.922419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.923920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.924644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:42.925241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:42.925516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:42.925785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:42.926503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:42.926800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:42.928231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:42.960473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 260/504] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.961297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.969134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 245/505] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:42.970408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:42.987131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.004624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.062632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce7876-34e6-496e-b255-58beeb20e7bb None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.072982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c23df-71e7-457b-855a-aefbfb0ce6eb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.097165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.097823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.098033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.098304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.098952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:43.099250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.100655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.106676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.107297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.107602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.107873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.108586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 261/506] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.109901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.118977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.120444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:43.135882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:43.136896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:43.137770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:43.137770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.137770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:43.137770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 246/507] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:43.138338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.205779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.213977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041c0d-707e-46d7-96e7-58ec10598d3c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.215564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.250731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76c95f-202a-49c4-b709-2b10945f46ae None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.252910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.253548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.253821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.254084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.264875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.266324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:43.280478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:43.282102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:43.282933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:43.282933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.282933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:43.282933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 262/508] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:43.283329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.286088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.287359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.287359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.287359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.360496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.361957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.388459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d34455-9f2b-4b09-8b58-42b119e2ec69 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.424979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.425584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.425864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.426135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.432105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.451861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.475698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 247/509] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:43.477016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.501756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.503767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.590348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aecf8-a9a2-4c86-8d54-8c1e82118274 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.619926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 263/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:43.620765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.636225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.637121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.637639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.637948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.652054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.653502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:43.674925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:43.676051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:43.676908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:43.676908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:43.676908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:43.676908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 248/511] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:43.677260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.692258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.703359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.749695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c78cd-3982-44ec-ad4b-bf7b2ce444d9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.788275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.788903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.789235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.789503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.790162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:43.790463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.791860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.797932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe7892-c03c-434e-8635-45ecbae6f1a6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.809826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 264/512] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.809826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.840152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.840911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.841186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.841453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.842091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:43.842387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.844544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:43.857916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 249/513] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:43.858550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:43.927389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7dc15-1f72-4dfe-847d-d71ce50a5568 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.947787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.948750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:43.973901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:43.974536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:43.974817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:43.975082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:43.975492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960112e-11e0-45e2-a3ea-8d695bc53b43 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:43.987314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:43.988945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:44.005429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.006454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:44.008054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:44.008054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:44.008054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:44.008054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 265/514] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.008054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.019684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.020325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.020590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.020856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.032464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.034009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:44.052063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.053175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:44.054750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:44.054750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:44.054750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:44.054750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 250/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.054750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.121102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4431c-4b7d-41b3-b036-e9532e6b6c24 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.160803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.161411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.161691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.161969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.162611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:44.162912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.164340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.174118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30dd40f-0a41-40ac-be15-62d3c6ba1454 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.178587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 266/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:44.179390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.206160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.210850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.213204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.213828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.214124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.214377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.222795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.224260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:44.235527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.236584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 251/517] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.237870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.290899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85c9d1-836f-47ca-95cb-ada8542e2085 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.329461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.329978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.330251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.330515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.331149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.332621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.342541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647283b5-5ac0-4af7-946a-1393757f3ce1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.353972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 267/518] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:52:44 2022] POST /identity/v3/users => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:52:44.356618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.382804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.383430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.383738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.384301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.384662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:44.384964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.386381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.406603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 252/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:44.406603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.467116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.469751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.491696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f88075-c3a0-4b77-821f-b95405dde9a6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.534518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.535150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.535428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.535742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.536167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055e557-6e39-4184-a253-f02bc3e4f240 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.536381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:44.537405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.539290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.553672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 268/520] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:44.554512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.579708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.580351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.580629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.580899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.589231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.590657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:44.604110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.605042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 253/521] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.605968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.670457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59bb1-a464-499f-b457-e46b4ad00795 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.707563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.708167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.708455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.708723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.709447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:44.709750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.711193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.716258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6cb55-49d5-40a5-a548-a6f9b6c673eb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.727525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.731175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.735804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 269/522] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:44.735804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.761838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.762467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.762744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.763013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.770795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.772262 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:44.784909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.785767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:44.786630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 254/523] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.787101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.847404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36968f-0d89-43fa-9ceb-6221c3edffad None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.885371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91184229-3efc-4b86-978c-18b267001499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.885999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184229-3efc-4b86-978c-18b267001499 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.886272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184229-3efc-4b86-978c-18b267001499 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.886539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91184229-3efc-4b86-978c-18b267001499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.894189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91184229-3efc-4b86-978c-18b267001499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.895673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91184229-3efc-4b86-978c-18b267001499 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.896400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1122d-9307-4919-b6cc-bc1a53b61ac5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-91184229-3efc-4b86-978c-18b267001499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:44.909178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:44.910322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:44.911345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:44.913071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 270/524] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:44.914022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91184229-3efc-4b86-978c-18b267001499 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:44.962506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:44.963173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:44.963526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:44.963715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:44.964527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:44.964777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:44.966200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:44.988473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:44.996916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 255/525] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:44.996916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.026973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.033574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91184229-3efc-4b86-978c-18b267001499 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.071139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.071785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.072059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.072325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.110584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338876d-2429-416b-8036-083ce398b4d2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.141273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.142732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.150407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.151004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.151277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.151565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.152242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:45.152539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.154161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.172961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 256/526] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:45.173784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.212752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.273595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 271/527] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:45.273595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.284183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.304759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616048e-aab4-43a3-8c0c-e8d0db3caff0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.341333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.341933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.342216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.342483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.343735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:45.344063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.345480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.362690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 257/528] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:45.362690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.387896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28ff8b-85c0-48f1-a4ad-040decd1f882 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.425169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.425685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.425947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.426213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.455550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.466971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417ef23-a3d4-4256-ac5c-4d972a007f6b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.502156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.502753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.503028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.503295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.504080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1a27293dafee4bf88135e986f6a73fdc) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:45.504380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.505785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.506334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.508177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.511168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 258/529] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/role_assignments?user.id=1a27293dafee4bf88135e986f6a73fdc&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:45.511963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.536797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.659082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424feb-a5a0-4d28-8915-6fbeffbc4069 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.667041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 272/530] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:45.668463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.701097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.702201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.703291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.703784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.715732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.717302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:45.734785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:45.735770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:45.736608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:45.736608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:45.736608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:45.736608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 259/531] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:45.736829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.741851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.792670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d7c52-c946-4d11-b3ea-c25fe5509f2b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.810387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:45.839602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.840543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.841441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.841852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.842985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:45.844259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.846560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.854156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 273/532] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:45.854718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee04161-2b8c-411a-860f-0158ef3fe2b6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:45.855685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:45.945058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:45.945605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:45.945910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:45.946162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:45.973098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:45.974710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:45.992285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdc3f-8527-49f0-acd0-873df956ac26 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:46.001416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:46.002572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:46.003701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:46.003701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:46.003701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:46.003701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 260/533] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:46.012734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.022922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.042000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.042882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.044364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.045867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.047509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:46.049309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.052640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.082906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 274/534] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:46.093676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.205064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449ce8-3d69-4e04-8933-d723a0864cd6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.257492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.271821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c3b35-0760-4751-9316-21e4434f056c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.304591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.305486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.305908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.306564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.308264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:46.309310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.310824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.338212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 261/535] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:46.346965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.347642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.347919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.348187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.348675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.355669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.357346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:46.375952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:46.377016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:46.378024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:46.383192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 275/536] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:46.386682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.488021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.563285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b8e9-5daa-4c0a-8a5a-9cdb8f899a3e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.595755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b29cb-a405-4936-bc62-dd6e73834195 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.634797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.635506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.635789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.636055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.648583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.650032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.663727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.664382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.664658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.664923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.665977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:46.666280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.667718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11571ac-8b2e-45d4-80a0-3739e61cddd4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ce5cd5e9-5871-4ac4-844f-48addb1dc101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:46.675963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:46.676826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:46.677636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 262/537] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:46.678092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8304a-7440-473f-8cc0-b3e8ce60c75b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.678369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8304a-7440-473f-8cc0-b3e8ce60c75b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.678632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8304a-7440-473f-8cc0-b3e8ce60c75b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.680112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 263/538] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:46.684328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8304a-7440-473f-8cc0-b3e8ce60c75b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.700443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 276/539] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:46.702147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.703290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.704003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.727777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:46.729412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:46.731792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.816261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8304a-7440-473f-8cc0-b3e8ce60c75b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.821295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 277/540] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:46.822420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.860119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:46.912209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.912829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.913121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.913581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.914118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:46.914421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.915926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.939180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a4ca4-808d-4c1b-bf39-5ad5767a068e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:46.941865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 264/541] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:46.947673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:46.980557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:46.981628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:46.982488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:46.982952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:46.984427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=8c44a2759eab46dbae21ad7eeb96df9a) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:46.985051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:46.986983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:46.994146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 278/542] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/role_assignments?user.id=8c44a2759eab46dbae21ad7eeb96df9a&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:47.127233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:47.135117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63547c22-88c7-41ef-8b2a-57ff8e0ab40f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.189361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.191047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.191047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.191047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.191273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=115a83b94378409ea1a6ce3443764cf1) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:47.191552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.193048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.195600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.201699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 265/543] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:46 2022] GET /identity/v3/role_assignments?user.id=115a83b94378409ea1a6ce3443764cf1&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:47.365889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:47.369755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bf27-8b7a-4a19-8aca-30658774a7cc None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.418825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.419371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.419794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.420062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.438507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:47.443542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:47.444413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:47.445183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 279/544] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:47.451067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.563230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6dbcc2-f3fd-4607-910d-01e55cdb7a0e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.598656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.599272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.599568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.599836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.600495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:47.600789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.602145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.612351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 266/545] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:47.618302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.752310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe07b1-6cfe-4e48-81f6-9e1458bf2bd4 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:47.804178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:47.804818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:47.805107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:47.805370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:47.819409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:47.821082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:47.839517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:47.840437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:47.841691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:47.841691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:47.841691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:47.841691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 280/546] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:47.848514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:47.894419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:48.035425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5de9-7373-43a1-adef-92a8825e681d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:48.080955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:48.081970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.082457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.082932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.083785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:48.084278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:48.085806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263fc7e-73ca-475b-ade4-0f158ffa9d0f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:48.106249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 267/547] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:48.112004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:48.135116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:48.138067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b248-836e-4f88-b1ca-cde2fe65eedf None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.138513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b248-836e-4f88-b1ca-cde2fe65eedf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.138691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0b248-836e-4f88-b1ca-cde2fe65eedf None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.141027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 268/548] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:48.148650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.148931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.149208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.183652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:48.184940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:48.329698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 269/549] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:48.340975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270a93-2247-49c8-b3a6-e7f631c1e1d5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:48.412167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:48.412807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.413089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.413364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.424466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:48.425911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-53887663-fc19-4142-b6a1-089363f94016 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:48.440815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:48.442752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:48.445158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 281/550] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:48.449846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:48.475845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:48.610542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7f4b-6021-4140-8414-971fc0527ac8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:48.654916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:48.655619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.656633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.656905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.657641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:48.657943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:48.659377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:48.674402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17c16-c297-4c14-8922-7e8a6274c049 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.674698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17c16-c297-4c14-8922-7e8a6274c049 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.674954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e17c16-c297-4c14-8922-7e8a6274c049 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.676645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 282/551] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:48.681679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.681956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.682223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.687074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 270/552] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:52:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:48.692796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:48.701641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:48.704200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:48.776043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:48.786584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:48.792205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 283/553] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:48.793361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:48.808231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815060-d3f9-487a-9660-fd6023413dda None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:48.884168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:48.884782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:48.885057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:48.885330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:48.947955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae35e07-681d-4ac9-a0fd-7e2185a74a79 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.008530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.009500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.009951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.010364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.019111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.020608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.022481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:49.027820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:49.028711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:49.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:49.037517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 284/554] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:49.038946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.122108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.147974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.173912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 271/555] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:52:49.175088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.185599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d04f5c-9747-47bb-957a-a6223ddeab3e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.231686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.232288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.232556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.232825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.233478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:49.233805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.235664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.246932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 285/556] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:49.247877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.285242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f229d79-e0ca-4a0d-abcd-919893f8b760 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.326358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.327895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.329023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.329509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.345609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:49.351864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:49.352834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:49.353627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:49.356010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 272/557] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:49.357242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.383570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b949-8644-47db-b0d2-85553f1503c8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.400194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.412782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.428200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.428830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.429313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.429471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.444113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.445575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:49.463622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:49.464613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:49.465484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:49.465484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.465484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:49.467537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 286/558] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:49.469050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.490262 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44eb7-316f-4e99-af86-eae421dadf0e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.529888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.531562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.532081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.532555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.544431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.547070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:49.564692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:49.565886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:49.566765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:49.566765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.566765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:49.569686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 273/559] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:49.570852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.597361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cb76b-5c0e-482e-a8e5-b6bfc3aa00e1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.648861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.649483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.649986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.650316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.650920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:49.651216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.652597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.668342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 287/560] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:49.668342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.678376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.705732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbde9c2-f78e-487e-bd13-2ae37deff662 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.717713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.746029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.746901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.747287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.747691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.748441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:49.748819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.750497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.763575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 274/561] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:49.764407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.792728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31183b8d-e7f8-4250-bc8c-4fa79818eb19 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.827324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.828205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.828483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.828757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.829395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:49.829698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.831071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72c2ec-66ab-4869-9688-25cff6bd3ff5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.842925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 288/562] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:49.845084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0a24-5ac4-4fba-b19d-6962ff61b5c7 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.845374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0a24-5ac4-4fba-b19d-6962ff61b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.845636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0a24-5ac4-4fba-b19d-6962ff61b5c7 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.847021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 289/563] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:49.847914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5623-6557-4212-b211-647e6e41398c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.848188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5623-6557-4212-b211-647e6e41398c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.848452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b5623-6557-4212-b211-647e6e41398c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.849612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 290/564] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:49.850362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5623-6557-4212-b211-647e6e41398c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.869240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce94205-2765-44de-b31f-96ef2ef7eba3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.904767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.905318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.905685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.906105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:49.915979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:49.917438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:49.919145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:49.933439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:49.934491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:49.935365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:49.935365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:49.935365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:49.935365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 275/565] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:49.935365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:49.950410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:49.957894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b5623-6557-4212-b211-647e6e41398c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:49.992335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:49.992957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:49.993236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:49.993510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.001630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.003074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-a9548f1e-87a9-46aa-8d88-d8c7f34fda54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:50.014248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.015324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:50.016252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 291/566] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.016872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.017173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.017416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.035133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:50.036454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:50.039769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743910f-bd5d-42e0-b227-814a0168b835 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.074760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.075379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.075679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.075946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.084041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.085448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-fc0d0b72-700c-4670-8b83-e83327375569 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:50.096558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.097664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 276/567] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.103708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.104574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.109921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 292/568] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:50.110753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.124967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:50.126234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:50.181069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.200818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 277/569] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:50.201712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.219336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.236538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f51c0-355a-4fb8-8a93-00293222985e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.283747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.284761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.285594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.286063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.287119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:50.287590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.289570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.304145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06851e73-73df-4231-a874-90627c24c1b3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.304990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 293/570] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:50.305980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.351455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.352293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.352983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.353368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.354440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:50.354847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.356640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.375716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 278/571] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:50.376821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.424936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.435305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7635-98fd-49c4-b970-4a0f477a6f84 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.471975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.472583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.472856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.473181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.473912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:50.474213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.475664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.486557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39923322-24b4-475f-a520-6e09d9c87cbf None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.498146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 294/572] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:50.498146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.500081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.528092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.528732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.529008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.529277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.537961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.539388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:50.551533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.552759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 279/573] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.553750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.601714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5301ce0-d6a5-4021-95c6-872813de3d86 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.638688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.639286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.639590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.639910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.640675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1192aab6e0444db1b006feb37c0fd3fa) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:50.640982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.642385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.647935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 295/574] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/role_assignments?user.id=1192aab6e0444db1b006feb37c0fd3fa&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:50.648709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.673149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9f8d6-d86e-40df-bc64-c7402807a468 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.677090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.714960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.715550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.715831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.716133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.728508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.728749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:50.734217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.735221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 280/575] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.740631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.776949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d4fe-a847-4870-9409-f279b86116ef None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.818191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.819123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.819393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.819740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.832387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:50.837687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.838630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 296/576] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.840168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.862627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df90b-419e-4362-b1a5-943039c110ec None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.898932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.899833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.899944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.900140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.912102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.913776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:50.929575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:50.935442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:50.936579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:50.936579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:50.936579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:50.936579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 281/577] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:50.936579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:50.953481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5187d8f-172f-4127-9420-3d828fad4e4c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:50.955656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.985561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:50.994285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:50.994881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:50.995154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:50.995419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:50.996163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:50.996467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:50.997880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.017493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 297/578] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.018325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.050275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1142a-18e0-4cc6-ac16-38a34c6149ca None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.088034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de928a3-4832-4825-acac-764410c2651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.088543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de928a3-4832-4825-acac-764410c2651d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.088818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de928a3-4832-4825-acac-764410c2651d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.089084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de928a3-4832-4825-acac-764410c2651d None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.089734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de928a3-4832-4825-acac-764410c2651d None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.090030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de928a3-4832-4825-acac-764410c2651d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.091363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de928a3-4832-4825-acac-764410c2651d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.100477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 282/579] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.100825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de928a3-4832-4825-acac-764410c2651d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.136231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aced-0476-427a-8293-572a547a5130 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.172823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.173478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.173694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.173962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.174620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.174918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.176332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.185421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 298/580] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.186220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.195344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.220931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de928a3-4832-4825-acac-764410c2651d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.237637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.260697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.261536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.261816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.262083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.262716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.263011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.264398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.281795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 283/581] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.281795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.301985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04779-bfc5-46ab-84b7-b7cb6e7e11e5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.339050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.340254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.340691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.341107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.353353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.355051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:51.371279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:51.372310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:51.373184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:51.373184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.373184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:51.373184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 299/582] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:51.373826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.390977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc7da-3938-459f-9944-5c33947f952a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.431997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.432624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.432897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.433163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.440304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.444276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.446325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:51.462064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:51.463227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:51.464319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:51.464319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.464319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:51.464319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 284/583] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:51.464319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.486595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.490213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e86467-ab20-4985-84d8-994676656dcf None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.536038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.536832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.536942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.537216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.550583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.552077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:51.568535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:51.569521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:51.570384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:51.570384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:51.570384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:51.570384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 300/584] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:51.570384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.584369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0a7d-ffc2-4d34-badb-079777ba2064 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.623355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.624016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.624912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.625186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.632598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.634010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:51.645269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:51.646149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:51.647013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 285/585] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:51.647544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.682847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f0d72-d263-42ad-b1d7-a6ffae434b6c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.702495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.718221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.719255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.719255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.719577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.720268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.720575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.722073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.739774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 301/586] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.740846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.757025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff6538-dba9-4cba-a3cb-d96a6af69a9d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.757580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.792939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.793703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.793982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.794551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.795193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.795522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.797950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.814874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 286/587] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.814874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.851007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76414b5-6264-4f54-91bf-442475434a00 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.894438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.894902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.895174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.895438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.896165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.896767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.897827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.910152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 302/588] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.910715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.927980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c989b7-d8c8-437a-b8b0-729c9d3a4254 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:51.939662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:51.964779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:51.965381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:51.965653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:51.965917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:51.966597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:51.966895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:51.968899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:51.985438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 287/589] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:51.985438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:51.992791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.034199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f68d2-6391-44b6-b4ed-2881d42ce5b6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.070810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.071479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.071762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.072028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.079186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.080640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.091757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fcba1-89c6-4e50-8cc0-1113954e28ae None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:52.091948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:52.092803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:52.094339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:52.098306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 303/590] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:52.099191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.132692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.133323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.133596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.133864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.142787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.144338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:52.157892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:52.158847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 288/591] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:52.160273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.191405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.235696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3dbc-3f0d-4b46-ac9f-067e758106e1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.270907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.278631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.279306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.279623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.279893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.280114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5c70a-1174-48a3-a30d-806b8074bb97 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.287993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.289450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:52.301751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:52.302717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 304/592] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:52.304251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.325243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.325987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.326353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.326561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/1a27293dafee4bf88135e986f6a73fdc/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.341727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=1a27293dafee4bf88135e986f6a73fdc, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.343444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.367491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 289/593] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:52 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/1a27293dafee4bf88135e986f6a73fdc/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:52.367491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.451368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d2a70-12f0-4fea-aebe-5ecb41876d77 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.463066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.488871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e41f4b-d146-4c7a-89e4-11f3a0853921 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.505989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.507164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.507675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.508381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.509694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:52.510160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.511903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.533961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 305/594] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:52.535068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.541846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.542663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.543037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.543400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.544272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:52.544679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.546903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.571210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 290/595] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:52.571210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.614999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.675010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026950-9bf8-4469-b232-161087a4d11a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.707650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee83e-fdf8-4a60-8e95-c3d36bfa83c0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.711798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.712400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.712672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.712939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.713719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:52.714019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.715430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.740790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 306/596] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:52.741717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.751432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.752131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.752403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.752670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.761833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.772575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=565774033b5d4aaab833757169efb547, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.774302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:52.796744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 291/597] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:52 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:52.802254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:52.917647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865814-38cf-4461-9d30-008d5e901c9c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.931579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:52.967866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:52.970143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:52.970755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:52.971107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:52.975904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a475a-454e-4230-aadb-def1c464d07e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:52.987782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:52.990182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-ad82f544-4697-4ded-87c4-38955a10a012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:53.013116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:53.014118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:53.015839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:53.015839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:53.015839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:53.015839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 307/598] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:53.020058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced8cb-8e74-4ba1-8ce7-572f5cc8d81d None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.020058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced8cb-8e74-4ba1-8ce7-572f5cc8d81d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.020058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced8cb-8e74-4ba1-8ce7-572f5cc8d81d None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.020058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 308/599] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:53.021544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced8cb-8e74-4ba1-8ce7-572f5cc8d81d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.025103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.025103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.025103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.025103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.042022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.043532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f07d71f2-7491-4bcf-a5bd-346f9e938bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:53.061059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:53.062493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:53.063609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:53.063609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:53.063609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:53.065271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 292/600] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:53.066609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.067036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.067441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.091327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:53.092797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:53.137784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.161293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced8cb-8e74-4ba1-8ce7-572f5cc8d81d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.186565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 293/601] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:53.196315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.205586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.206618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.207044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.207455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.208324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:53.208805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.210515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.224860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 309/602] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:53.231841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.262188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.346272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452024dc-4747-42fb-9bee-1b0dbfb8350e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.392234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.392901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.393173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.393440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.408199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.409665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.413312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227c84-3304-42a5-932b-f499017d14a8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:53.432615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:53.433733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:53.434805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 310/603] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:53.442392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.469671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.470697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.471172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.471692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.472518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:53.472964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.474475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.489456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 294/604] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:53.494870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.561154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.619860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.627399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a7fdb-819d-4604-8c95-9fdc9eb04931 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.646184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cde3b7-b7dc-4da5-bcef-61e49795b51b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.664319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.665144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.665578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.666000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.666824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:53.667261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.668862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.681720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 311/605] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:53.682807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.696318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.696983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.697268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.697590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.708273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.709718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:53.727821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:53.728906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:53.729853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 295/606] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:53.730322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.806570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509811c-5808-4170-b876-a7e857fb702e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.851406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.852357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.852730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.853096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.865017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.866291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:53.873338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:53.874764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:53.875823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:53.882152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 312/607] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:53.882152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:53.882152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:53.892346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719534d-923d-46d6-9710-1e67b444b4bd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:53.945484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:53.946377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:53.946818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:53.947243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/8c44a2759eab46dbae21ad7eeb96df9a/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:53.963227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=8c44a2759eab46dbae21ad7eeb96df9a, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:53.964887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:53.987020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 296/608] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:53 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/8c44a2759eab46dbae21ad7eeb96df9a/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:53.988609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:54.049473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a7c1-e329-4fd5-a581-18033d533a31 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:54.133467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba86590-5b2f-4fb7-832e-49fba7c19432 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:54.179020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70420-de29-42ef-b717-2425272e224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:54.179516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:54.179728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70420-de29-42ef-b717-2425272e224f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.179957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70420-de29-42ef-b717-2425272e224f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.180239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b70420-de29-42ef-b717-2425272e224f None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.180940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70420-de29-42ef-b717-2425272e224f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:54.181230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.181331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70420-de29-42ef-b717-2425272e224f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:54.181830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.182290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.182682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b70420-de29-42ef-b717-2425272e224f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:54.183490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:54.183986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:54.185645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:54.196557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 297/609] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:54.203204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:54.212116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:54.225529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 313/610] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:54.239864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70420-de29-42ef-b717-2425272e224f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:54.362196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:54.370597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3d17c-214e-4232-9d6b-f907818d51e1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:54.417272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:54.418879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.419354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.420048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.435235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:54.437401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:54.453857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:54.454833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:54.455731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:54.455731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:54.455731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:54.457792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 298/611] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:54.462562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b70420-de29-42ef-b717-2425272e224f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:54.464084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:54.582706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:54.583777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.585312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.589581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/115a83b94378409ea1a6ce3443764cf1/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.629335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=115a83b94378409ea1a6ce3443764cf1, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:54.631173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:54.637949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:54.665081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 314/612] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:54 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/115a83b94378409ea1a6ce3443764cf1/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:54.782658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a388b-c6f7-4524-81c6-bff2a5a47bef None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:54.841998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:54.842614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.843492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.843761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.844527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:54.844833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:54.846215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9550ce-810e-4409-90ab-527458ee4eed None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:54.866966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 299/613] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:54.873070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:54.976022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010227bf-d0e4-45dc-bdcc-06dcce1bb9dd None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.976346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010227bf-d0e4-45dc-bdcc-06dcce1bb9dd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.976573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010227bf-d0e4-45dc-bdcc-06dcce1bb9dd None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:54.979235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 300/614] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:54.983630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ddb31-9b84-4c55-9850-b0f1331deab0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:54.984406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ddb31-9b84-4c55-9850-b0f1331deab0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:54.984713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ddb31-9b84-4c55-9850-b0f1331deab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.004159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-613ddb31-9b84-4c55-9850-b0f1331deab0 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:55.005427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-613ddb31-9b84-4c55-9850-b0f1331deab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:55.010571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63f43-60a0-410f-83e9-3aa072853c0a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.028568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.072768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.075189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.075488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.075742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.093431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:55.096353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:55.121510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:55.122495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:55.123419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 315/615] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:52:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:55.127485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 301/616] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:55.128764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.161776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250462-1915-4cb9-87e5-c8606d704835 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.162053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250462-1915-4cb9-87e5-c8606d704835 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.162323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250462-1915-4cb9-87e5-c8606d704835 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.163820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 302/617] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:52:55.170343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.170623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.170894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.195397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:55.196628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:55.275557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.325520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa456a9-57f2-4c97-bf97-fcc0a3d089d1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.341766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 303/618] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:52:55.363117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.363748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.364019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.364284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.365010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:55.365310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:55.366757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:55.387706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 316/619] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:55.392975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.472748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.505620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.567259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac813800-7c8a-4298-b323-12b68f49cc72 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.631584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0c8e-b128-430e-b95a-ab9c84ad9e10 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.636776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.637523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.637902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.638270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.657254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:55.660254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:55.685306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:55.686544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:55.688108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:55.688108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:55.688108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:55.696580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 304/620] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:55.700381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.708827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.709474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.709749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.710020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.725346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:55.732468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:55.732622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:55.734218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:55.735134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:55.739854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 317/621] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:52:55.739854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.819743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb0e7-437d-47e2-a830-a62b8c29a72a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.837653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:55.848687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923003-1844-4712-8d03-859f30472f54 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:55.859762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.860669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.861087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.861523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.862300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:55.862740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:55.864444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:55.878606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 305/622] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:55.885440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:55.885998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:55.886282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:55.886551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:55.887761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:55.897746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:55.902946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:55.903865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:55.904685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:55.908892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 318/623] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:55.909833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.003113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.022329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff556260-be5f-4ebc-882d-4203d6533bc0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.023661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5365753-e381-41ae-9ad9-77d17287b1ed None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.064908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.065603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.065928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.066201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.068062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.069222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.069727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.070211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.071082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.071625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.073051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.073701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.074476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.084818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 306/624] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:56.086133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:56.088656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:56.089544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:56.090425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:56.095367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 319/625] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:56.096352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.119892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.210860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed1ba3-b7a6-4da5-9ae3-4aede0137015 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.224947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812451e-6327-4516-8ddf-f65ffd20caa3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.245117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.245745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.246016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.246279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.257737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.259264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.263295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.264101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.264552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.265560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.266364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.266810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.268477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:56.274531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:56.275732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:56.276703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:56.276703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:56.276703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:56.279890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 307/627] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:56.280465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 320/627] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:56.281996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.282381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.296224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.347279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.388084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d2c71-c889-404d-9a24-5833bad1a56a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.401564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae7c8d-9095-4882-928e-6fe6b6914268 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.425080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.425683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.425956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.426222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.427285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.427285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.428595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.442865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.443751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.444183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.444621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.445457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.445918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.446030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 321/628] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:56.446846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.447932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.462263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 308/629] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:56.463455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.550856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.559695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e358bf-1719-4e58-876a-23bcb75ddb39 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.585468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121a403-5f7a-40a2-b4b9-a16b240311f9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.587228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.596465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.597108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.597384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.597655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.608466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.610460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:56.626039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:56.627176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:56.628401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:56.628401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:56.628401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:56.630523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.631407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.631906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 322/630] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:56.632078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.632500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.632776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.640895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.642580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:56.656253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:56.657594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:52:56.658777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:56.660512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 309/631] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:56.661496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.747691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b86bf-82ce-41ef-842c-bd30742401a0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.775443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548e3bf-e565-41a7-824a-52e84f8b80fd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.785046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.785664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.786025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.786359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/1192aab6e0444db1b006feb37c0fd3fa/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.801761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=1192aab6e0444db1b006feb37c0fd3fa, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.803383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.810329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.818233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.818961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.819560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.819707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 323/632] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:52:56 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/1192aab6e0444db1b006feb37c0fd3fa/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:52:56.819818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.820695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.821149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.822662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5714151-3ff2-4380-a566-d07d9c8f953a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:56.824724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.838745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 310/633] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:56.840581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd0fb-da92-4143-a941-03d9e9c2eead None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.840874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd0fb-da92-4143-a941-03d9e9c2eead None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.841253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edd0fb-da92-4143-a941-03d9e9c2eead None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.843762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 311/634] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:56.849280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.849703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.850363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.859372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:56.880070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:56.881578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:56.955433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ace-e1d7-49e6-b3d5-d2a800363df9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:56.962807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 312/635] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:56.963933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:56.995214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:56.996038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:56.996428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:56.996809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:56.997677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:56.998150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:56.999840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.022484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 324/636] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.033263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.085968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a0a3-3aaf-481f-821a-871d7af08b69 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.113518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.131332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.132178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.132557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.132931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.141718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.143138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ad0ef0b4-943b-4920-b6e6-5392760c6f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:57.159994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.161237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:52:57.162408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:57.164628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 313/637] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:52:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:57.165967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a689-88aa-46dc-9652-8a302cefbcc2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.166398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a689-88aa-46dc-9652-8a302cefbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.166815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555a689-88aa-46dc-9652-8a302cefbcc2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.168475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 314/638] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:57.169776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a689-88aa-46dc-9652-8a302cefbcc2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.180414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.205206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671c453-3f25-4fdc-a9a2-bb2559b8fcd4 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.248239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.250628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.250902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.251171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.299852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555a689-88aa-46dc-9652-8a302cefbcc2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.326023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.327552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.337151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.338078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.338693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.339073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.340065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.340470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.341974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0be07-a441-45ab-9b13-78e822d7b99d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.366415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 315/639] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:52:57.366415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.366415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.366415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.382592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:57.384006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:57.415894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.416430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.439511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 325/640] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:57.440123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.471661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 316/641] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:57.471661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.549615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ae1da-55fc-43bc-96e3-34ffc583f6c1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.589892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.590702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.591131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.591625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.604846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:57.610687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.611847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:57.612990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:57.619425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 326/642] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:57.621273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.626355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c0bf8-9615-49b4-994d-2efb755d0842 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.673003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.674329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.675833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.676267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.676684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.725883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.740209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ec1e4-d10a-4ff4-b64c-113b67588621 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.774787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.776472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.776894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.777515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.777786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.778052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.789506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.790949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:57.805440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:57.806645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:57.807573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:57.807573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:57.807573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:57.807573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 327/643] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:57.807820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.900684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 317/644] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:57.900684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:57.916817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.924479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33a037-c2e9-4a1a-a855-ca1d3dd1d3dd None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:57.961236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:57.961847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:57.962125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:57.962395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:57.963057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:57.963361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:57.964771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:57.970353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:57.973711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 328/645] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:57.974525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.013856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061b45-f26f-4cd8-a060-0cea0e052804 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.051025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.051606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.051889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.052163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.064859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:52:58.069870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.070794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 318/646] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:58.071783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.087103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5891ee-af2e-45bd-a661-2b41eb94d846 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.123707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.125166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.125445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.125712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.126344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:58.126645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.128022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.140531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 329/647] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.141325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.162702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.187924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca67c9-65c8-44e9-aacb-b3ebd44e1bb0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.218493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.228494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.229225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.229664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.229994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.241452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.243001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.253983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201e13c-b26d-4f9a-bab2-ba24b06fee2b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:58.259506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.260445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:58.261336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:58.261336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.261336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:58.265689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 319/648] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:58.266717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.291921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.292552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.292827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.293097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.303949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.305338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:58.320372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.321376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:58.322262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:58.322262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.322262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:58.322262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 330/649] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:58.322262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.384262 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1786c0-61f3-4a17-8efd-749da8be192e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.397301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.422463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.423172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.423549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.423889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.424623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:58.425207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.426460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.441870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289b5f7-1cc8-4aad-b18c-1fd4ed7a0fef None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.442919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 320/650] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.442919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.476913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.477533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.477815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.478082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.485134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.486568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.493972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:58.498039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.499176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:58.500251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 331/651] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:58.500745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.569703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb08d20-406e-4a12-91be-1e4a6b50d1c6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.605869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.606475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.606761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.607029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.607710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:58.608014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.610289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.611217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359999-7a39-4f15-88a7-a6b8549fd496 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.626550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 321/652] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.626550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.646034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.655144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.656539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.656949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.657530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.657879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:58.658178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.659575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.672926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 332/653] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.673589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.739975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5e82-95c8-43c8-b6e3-8ef6c59c97b9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.741661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.781799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.782524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.782801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.783072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.785415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff286-74a3-4e1f-9739-75e428b0eac2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.793747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.795429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:52:58.810960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.813030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:52:58.814135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:52:58.814135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:52:58.814135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:58.818952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 322/654] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:58.818952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.832053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.832677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.833027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.833407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.834201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:58.834610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.836153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.849784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 333/655] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:58.855199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:58.908580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:58.932792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa2fda-e500-4cd8-bef2-10968ee2732b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.968566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e0858-2f54-48a4-8a50-4188f753ad5b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:58.970369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:58.971065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:58.971423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:58.971800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:58.978863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:58.980406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:52:58.992814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:58.993917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:52:58.994983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:58.998934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 323/656] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:59.000633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.008797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.009972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.010361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.010732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.016925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.022133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.023803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:59.041032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:59.042268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:52:59.043419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:52:59.050899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 334/657] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:59.050899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.111387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263e9c3-d6fe-43ad-a79b-3391d6b16595 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.148847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.149452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.149723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.149986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.150615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.150910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.152265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.159941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496f00d-d7ee-4f94-b0a2-3c8dd045b09a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.163830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 324/658] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.164614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.170658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.198628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.199228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.199533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.199812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.201259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1a27293dafee4bf88135e986f6a73fdc) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.201259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.202239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.207896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 335/659] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/role_assignments?user.id=1a27293dafee4bf88135e986f6a73fdc&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.208675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.247248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.276537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18ba5d-5b72-4c87-9f6c-09e9ca3ac2bf None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.315860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.316481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.316785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.317053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.317758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.318061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.319557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff15dc3-42f6-4f10-8692-8a9dc348fe65 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.332560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 325/660] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.333848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d5d-bfa5-4a48-b491-67a4b72ba7f9 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.334136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d5d-bfa5-4a48-b491-67a4b72ba7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.334407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef7d5d-bfa5-4a48-b491-67a4b72ba7f9 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.335908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 326/661] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:52:59.336553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef7d5d-bfa5-4a48-b491-67a4b72ba7f9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.347092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d8b23-45d3-478d-a68d-1c6a5e184405 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.400318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.400932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.401208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.401475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.402199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.402504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.403996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae9c01-f548-4f34-8da5-4d9a768db86b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.425298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 336/662] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.426544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.426830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.427102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.447050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:52:59.448290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:52:59.462836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef7d5d-bfa5-4a48-b491-67a4b72ba7f9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.476232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.506483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.507114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.507393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.507699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.509606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.520028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.521457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.531940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 337/663] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:52:59.533094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:52:59.539607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:52:59.540725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:52:59.541885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:52:59.544075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 327/664] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:52:59.545005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.650990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc34e75-a47a-4bdd-8d59-49619dd80a3b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.687436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.688225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.688623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.688960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.689773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.690172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.691817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.695497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa88a-4610-4e01-aa0e-72190de2e9c8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.704119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 338/665] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.705209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.740956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.741906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.742331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.742989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.768742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.829328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:52:59.839195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.841050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.913325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef536-7e1d-4a62-b04b-7ca0aefa7f5a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:52:59.961714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:52:59.962314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:52:59.962584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:52:59.962854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:52:59.963630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:52:59.963935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:52:59.965356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:52:59.971986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 328/666] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:52:59.972846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:52:59.992520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 339/667] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:52:59.993369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.096477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234508ed-d8fc-4d7a-902b-45bfe5fc695c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.097666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.099878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.126390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84974bcd-e3f5-48fc-bc72-914fe9759fe6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.136924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.137858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.138681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.139171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.153133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:00.160701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:00.161624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:00.162455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:00.165333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 329/668] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:00.166602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.169529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.170405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.171063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.171730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.189515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.191482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:00.212779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:00.213959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:00.215078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:00.215078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.215078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:00.217931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 340/669] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:00.220153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.298012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7394c-e2c1-42f8-ae60-af4626674252 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.336020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.336794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.337173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.337547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.360121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0ce2b-c566-4e23-bf05-94190493be0e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.363859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.411811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.412728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.413191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.413884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.415124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:00.415896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.417398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.419823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.423906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.425486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.436085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 341/670] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:00.436829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.563931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 330/671] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:00.565326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.580439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a240a22-bee9-4d55-a4df-c57683e993d9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.623663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.624712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.625281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.625756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.626618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:00.627117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.628713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.637703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.648309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 342/672] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:00.649503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.695787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a76a3-1e49-4b3a-9dc0-14515e67c3df None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.713530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.745859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.747641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.748151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.748620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.760275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.762068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.771130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444cbad-5896-4cc6-8565-90cfc5040557 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:00.778716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:00.779670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:00.781189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:00.781189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.781189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:00.788062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 331/673] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:00.789334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.814885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.815644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.815974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.816230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.829596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.831574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:00.850465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:00.856759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:00.857731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:00.857731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:00.857731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:00.857731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 343/674] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:00.857731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:00.925742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af49e4-309b-4b00-a09a-b307def47db3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.937580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.972707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:00.973114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8069d-81fb-493b-a181-5cdec3d31ece None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:00.973237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:00.973513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:00.973778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:00.982291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:00.984991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:00.985239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:00.998950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:01.000307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:01.001192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:01.007815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 332/675] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:01.008928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.016314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.016923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.017198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.017465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.018102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.018399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.019788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.040840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 344/676] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.040840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.126674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e569bf-75a2-442e-a25e-26c7624a5f9b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.163917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.164931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.165442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.165916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.166760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.166877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e514-185d-44d2-bc18-a71b8d3ee4eb None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.167422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.169073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.187933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 333/677] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.189172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.208914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.209646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.209917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.210553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.211316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.211644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.213114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.221738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.238442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 345/678] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.238442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.269965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.309333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbeedd-f996-4e65-b4e7-2fc0e58adfcd None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.346895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.347984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.348775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.349250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.356911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.358783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.360736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda3cb-1aed-4612-996d-7c8933ba73f3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:01.375587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:01.376550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:01.377472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:01.386276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 334/679] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:01.387368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.398596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.399228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.399518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.399790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.409225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.410983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:01.426420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:01.427393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:01.429120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:01.431563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 346/680] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:01.432781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.494636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.513182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46a53b-cc73-4b95-a03a-d7894ad6bed9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.552360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.553360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.553875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.554350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.555210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.555883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=8c44a2759eab46dbae21ad7eeb96df9a) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.556410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.558532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.571507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 335/681] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/role_assignments?user.id=8c44a2759eab46dbae21ad7eeb96df9a&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.571507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.571760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6aa30-8e46-47b6-9a19-b84e00355a6a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.612537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.613213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.613489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.613672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.614414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.614713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.616298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6b3c5-3468-4cd9-b60f-58099b9153cd None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.644653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 347/682] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.648978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc815e-2596-4328-8835-3540743b7198 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.649289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc815e-2596-4328-8835-3540743b7198 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.649511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc815e-2596-4328-8835-3540743b7198 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.650852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 348/683] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:01.651597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc815e-2596-4328-8835-3540743b7198 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.736790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bda014-d97b-4e2b-b3bb-36fc6dc3969c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.781706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.781706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.781706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.782031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.782894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:01.783147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.784793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96f433-ac69-485f-b5e9-45b47d95c697 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:01.793564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc815e-2596-4328-8835-3540743b7198 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:01.799108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 336/684] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:01.800486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.800773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.801045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.825309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:01.825897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:01.830063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.842074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:01.842491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:01.843364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:01.843730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:01.864863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:01.908467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 337/685] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:01.909327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:01.938755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:01.940481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.039132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee37bc6-6a9f-4194-a9c2-8be7c23c9875 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.056823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 349/686] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:02.064412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.089195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.091176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.091452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.091739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.092460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=115a83b94378409ea1a6ce3443764cf1) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:02.092837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.094762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f7d56-7322-406a-83e6-d99816d6a989 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.110077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 338/687] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:01 2022] GET /identity/v3/role_assignments?user.id=115a83b94378409ea1a6ce3443764cf1&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:02.141764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681446-aff8-43ce-af08-ef7e1a749838 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.142087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681446-aff8-43ce-af08-ef7e1a749838 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.142315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16681446-aff8-43ce-af08-ef7e1a749838 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.147621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 339/688] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:02.149895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.150184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.150458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.150740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.160989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.196706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:02.197942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:02.230118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39da925-d34b-486f-bbe8-e00a7f7ab3dd None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.270916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.272062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.272341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.272607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.285379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.286875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:02.304446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:02.306343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:02.307705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:02.307705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:02.307705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:02.307705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 350/689] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:02.312927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.350979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 340/690] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:02.351866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.421580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f986a6-5e5b-4803-9c4e-cbea3cfd2614 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.443833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.454899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd5d28-ed41-483e-9afc-57798a526e1b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.465823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.467495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.468357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.468627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.469273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:02.469894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.471571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.495898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 351/691] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:02.500923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.508038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.508670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.508942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.509212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.511152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.536939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.538855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:02.555974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:02.556948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:02.557816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:02.557816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:02.557816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:02.560094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 341/692] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:02.566682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.625329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae55bdf-3154-47b8-a934-74fce46abbd3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.679989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.680616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.680890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.681152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.694198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.697579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.704970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7277-89be-4daf-a819-e3730d84c9e1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:02.714564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:02.715651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:02.716527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 352/693] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:02.717003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.742414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.759443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.761685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.762128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.762542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.763350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:02.763814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.765874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.782974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 342/694] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:02.784182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.841446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582cfb-d796-4fd7-af81-22a1850e434b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.853769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:02.889849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.890976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.891400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.892535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.905452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:02.911021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:02.912031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:02.912872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:02.913517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e4d0c-9e58-4a33-92e8-7d449cd0748c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:02.920113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 353/695] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:02.922041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:02.954922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:02.955691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:02.956055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:02.956347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:02.957137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:02.957518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:02.959067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:02.972195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 343/696] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:02.977792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.012298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.038886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49443c51-ebfa-4714-8c1c-6193893f883b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.077712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.078627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.079139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.079758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.080588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.082207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.082679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8538f-49cd-4106-9c09-49d38a268303 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.090080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.109346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 354/697] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:02 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:03.110612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.155803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.156805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.157263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.157758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.158608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:03.159086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.160787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.179184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 344/698] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:03.185992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.267895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3f92-243d-4fcc-a7f3-3cab0ab86f04 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.309824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.310541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.310790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.311037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.312908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1192aab6e0444db1b006feb37c0fd3fa) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:03.313218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.314685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.316762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.324154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 355/699] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:03 2022] GET /identity/v3/role_assignments?user.id=1192aab6e0444db1b006feb37c0fd3fa&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:03.411659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626115c-5606-427f-a1ee-aeea49bcc818 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.450917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.451663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.451937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.452738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.465192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.466883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:03.484018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:03.485122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:03.485993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:03.485993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:03.485993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:03.485993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 345/700] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:03.492368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.628017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95652-fc98-43d3-a1c5-eb6444fa312e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.663954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.664463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.664798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.665070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.665706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:03.666000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.667395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.680446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 356/701] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:03.686144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.718443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.814413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9f11-a60c-41c0-b499-18a80f9c669f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:03.852001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:03.852630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:03.852906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:03.853173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:03.862462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:03.863938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:03.876471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:03.877383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:03.878975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 346/702] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:03.883384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:03.951010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:03.997092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4186-1b80-4f89-bd28-3205aa7fcf6e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:04.050037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:04.050648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.050923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.051194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.052013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:04.052321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:04.053761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7a27-e8f9-4d78-a613-78cd7f680691 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:04.078884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 357/703] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:04.084716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.133729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3c5-5d86-47a5-ba31-0221aa37fb14 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.134047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3c5-5d86-47a5-ba31-0221aa37fb14 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.134276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e3c5-5d86-47a5-ba31-0221aa37fb14 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.135870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 358/704] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:04.141282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.141562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.141836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.161670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:04.162961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:04.175118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.204244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912640-3282-4e47-9080-2c4d5ae01236 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:04.250143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:04.250820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.251100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.251371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.307759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 359/705] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:53:04.350363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:04.352199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:04.438445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.459587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 347/706] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:04.468891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.540929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.622631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365e64-e1d6-4c62-8f14-5abf2186cd83 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:04.649339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.675496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:04.676187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.676408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.676677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.699331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:04.703938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:04.735859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:04.736818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:04.738396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:04.738396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:04.738396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:04.738396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 360/707] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:04.743646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.869643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317959f-daed-4862-b158-ff8ba0bc384d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:04.912344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:04.912977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:04.913255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:04.913521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:04.914106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:04.915452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:04.928934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:04.931275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:04.933326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 348/708] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:04.940156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:04.983092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:04.990583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478e7d-417f-4eb0-8619-2951507cd69a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:04.997144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.052885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.054135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.054682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.055250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.056518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.057251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.059942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef7c8b-bab0-4929-a693-dff78a926f24 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.068354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf3ce-b058-4742-9fb6-a676195c5398 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.087912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 361/709] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:05.090222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4400-0a59-4177-b11b-41ee6a7f243e None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.090792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4400-0a59-4177-b11b-41ee6a7f243e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.091349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4400-0a59-4177-b11b-41ee6a7f243e None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.095923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 362/710] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:05.103676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4400-0a59-4177-b11b-41ee6a7f243e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.107781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.109165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.109594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.110038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.112027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.112571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.115117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947baec-0401-4418-96ea-449764b0d04a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.127880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 349/711] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:05.130238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.130559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.131043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.164570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:05.166571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:05.233159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4400-0a59-4177-b11b-41ee6a7f243e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.269801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 350/712] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:05.270986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.272460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.273465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.273756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.274026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.283263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.288816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:05.308576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:05.309542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:05.310512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:05.310940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 363/713] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:05.325048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.325897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.388149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.495872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac46407-a245-46d5-9f34-2ffe2b9b7264 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.594380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.594619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab6e6-0d2b-47f1-b436-51fb9b921196 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.595309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.595787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.596226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.603721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.604213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.606565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.617113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 351/714] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:05.618562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.664003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.664910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.665330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.665739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.666822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.667283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.672734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.694256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 364/715] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:05.705685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.898875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.926612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0817-83c4-4a72-981b-052ec66cf5f3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.928361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:05.940637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277b29-9b08-4b9b-a873-83ebb6452dc9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:05.969384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.970051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.970455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.970727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.971313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.973443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:05.983936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:05.985017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:05.986009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 352/716] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/services/network => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:05.991287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:05.992088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:05.992428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:05.992780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:05.993625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:05.993988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:05.995911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:05.997565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.009834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 365/717] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.166734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211e65d-1caa-4b2d-bef5-d1e48ba2c7e8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.213893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.214537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.214820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.215090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.215794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:06.216098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.217523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd7eb-7221-49e8-b4b5-1be85cc7bfb2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.226961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 353/718] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:06.236666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.397815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9908-6829-42e9-92f2-079a7bba6a8a None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.398100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9908-6829-42e9-92f2-079a7bba6a8a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.398635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c9908-6829-42e9-92f2-079a7bba6a8a None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.400530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 354/719] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:06.405645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0343c-ead2-491b-854b-2ac2a231ce9e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:06.407192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.407712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.408195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.438799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:06.440360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:06.463039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:06.465246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.465537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.465808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.466443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:06.466749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:06.470519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438adeb-c3dd-4b8d-9f66-9ddcd1838cf1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:06.476958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 366/720] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:06.490940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.499050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda48dd-c0a7-4886-81f4-e89b563089b8 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.499448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda48dd-c0a7-4886-81f4-e89b563089b8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.499973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda48dd-c0a7-4886-81f4-e89b563089b8 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.501894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 367/721] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:06.508956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:06.509263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:06.509511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:06.539855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:06.547317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:06.548636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:06.587587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 355/722] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:06.692002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 368/723] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:06.867998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:06.975859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1558ad7-ed68-47d7-aa2e-4b1ec123df47 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.020174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.020824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.021108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.021375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.032783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:07.037671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:07.038675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:07.039574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:07.043776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 356/724] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:07.044521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.082487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.111834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.206230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c310-2348-46f3-89ca-50622132ab6d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.233038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9044-fdb1-4726-93a6-20de368e60bc None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.242548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.243154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.243430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.243749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.244410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:07.244710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.246084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.248344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.256784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 369/725] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.262295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.308789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.309431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.309709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.309976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.333230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:07.338227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:07.339153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:07.340606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 357/726] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:07.345520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.384081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434643-9700-411c-8a1c-97d984e78317 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.458643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.459276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.459579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.459847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.483927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade31eb-6a63-4378-8b01-98f7e06a1832 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.487179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.487897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.488757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:07.513565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:07.515107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:07.516476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:07.516476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:07.516476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:07.521134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 370/727] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:07.527512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.568259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.572240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.572734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.573210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.574081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:07.574640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.580256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.595828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 358/728] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.602557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.602806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.705076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051d21a-9b10-4981-a367-24b9936e48b0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.743433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f327aa-22f0-4c4a-a506-dc783b74fe11 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.776781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.777401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.777712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.777988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.778630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:07.778978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.780988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.783552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.784189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.784471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.784803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.796945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.798648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.800441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.802892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 371/729] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:07.808803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:07.816784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:07.817730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:07.818601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:07.818601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:07.818601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:07.818601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 359/730] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:07.826099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:07.924844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243756e1-48cf-4da0-ae3b-4448a4a695d9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:07.955834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:07.975699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:07.976339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:07.976617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:07.976889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:07.989630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:07.991095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:07.994306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5969a7f-315a-4df0-989a-c6b580133124 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:08.017146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:08.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:08.019147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 372/731] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:08.025049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.065859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.066517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.066798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.067069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.067739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:08.068040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.069507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.086750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 360/732] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.091852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.185770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.235993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb006c1-3f2c-451e-8f2d-ce7d327bc566 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.285170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccedce-00d7-4192-ab64-d96bc9ed6263 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.313616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.314230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.314505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.314773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.315511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:08.315818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.317264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.350627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 373/733] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.355632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.358334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.359448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.359835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.360109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.368056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.369491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8c9b07c0-a549-48b2-ad52-7bccd51e6b52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:08.382561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:08.383583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:08.384512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 361/734] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:08.390128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4416-fc39-43f4-80e8-0347844be0fc None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.390681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4416-fc39-43f4-80e8-0347844be0fc None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.391166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4416-fc39-43f4-80e8-0347844be0fc None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.393013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 362/735] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:08.393948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4416-fc39-43f4-80e8-0347844be0fc None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.410900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.491079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90e67-10a5-43b5-98d7-8ba77f294bf2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.538149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4416-fc39-43f4-80e8-0347844be0fc None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.567984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.584850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.585885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.586406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.587047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.588135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:08.588665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.590354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac2a32-31ba-4244-959c-ac7d4164d7bb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.612855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 363/736] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:08.614588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.615082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.615593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.637544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:08.638980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:08.648985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.649826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.650279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.650690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.727312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.735538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 364/737] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:08.735710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0057077-be19-4a7a-aa1d-a5246ee2e633 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:08.735797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.762895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.844125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065df85-e91d-44c7-8cc8-b95ab7c756e8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:08.846167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:08.869360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 374/738] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:53:08.870998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa1f5d-6556-4ff2-9ee7-15efabd10c55 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.871281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa1f5d-6556-4ff2-9ee7-15efabd10c55 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.871581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa1f5d-6556-4ff2-9ee7-15efabd10c55 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.877281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 375/739] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:08.877281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa1f5d-6556-4ff2-9ee7-15efabd10c55 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:08.891215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:08.892213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:08.892744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:08.893278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:08.969619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:08.971500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.008582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa1f5d-6556-4ff2-9ee7-15efabd10c55 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.038898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.048834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.049783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.049895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.050075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.064777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.066556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0bb25076-d82d-4482-a576-420bde0f6b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:09.085088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:09.086094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:09.087008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:09.087008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:09.087008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:09.087008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 376/740] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:09.087851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.087851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.088026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.098996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 365/741] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:53:09.098996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.098996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.111734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:09.113012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:09.183854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 377/742] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:09.188396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.203846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198574af-f260-42a5-86d7-11a3447f1abf None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.239860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.240471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.240749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.241018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.241679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.243044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.261069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 366/743] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:09 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:09.262074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.307322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865cc7-ecae-4526-994f-d08b4d0a73e8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.321852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.364404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.368389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.369111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.369460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.369804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.370530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:09.370924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.373204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6221db-59be-4d44-8cbe-6e3a2cb5108a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.396628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 378/744] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:09.396628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ca2-7120-4f4e-bb71-5c3d7f5b8893 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.396628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ca2-7120-4f4e-bb71-5c3d7f5b8893 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.396628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f5ca2-7120-4f4e-bb71-5c3d7f5b8893 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.399601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 379/745] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:09.400715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5ca2-7120-4f4e-bb71-5c3d7f5b8893 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.432424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1bdcb-2748-4b59-963c-3d5a05dea963 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.472966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.473874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.473874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.474120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.486028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.487484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-faf09eb1-04db-4994-a50a-81621e21dad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:09.503713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:09.504742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 367/746] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.506256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.506682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.525974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:09.527410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:09.537569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f5ca2-7120-4f4e-bb71-5c3d7f5b8893 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.573418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.574040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.574315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.574587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.581452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.582894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:09.594512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:09.595420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 380/747] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:09.596376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.609215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 368/748] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:53:09.610219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.650637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.665703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.730071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4513-6141-4cc5-ae09-ce7c34ec7e01 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.756422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeac5be-ee03-4761-b623-e4e49fd2adad None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.770594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.771150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.771423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.771709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.772348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:09.773393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.776327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.795387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 369/749] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:09.797092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.814163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.814795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.815124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.815698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.827389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:09.833441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:09.834399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:09.835214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:09.839578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 381/750] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:09.840524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.928943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048cf3e-0f99-4c0a-b590-29fdfadd984d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.931270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.935406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:09.954874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef6f2-b282-4a27-86dd-43e174144af0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:09.968345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.969100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.969390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.969659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:09.970345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:09.970651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:09.972124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:09.990049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 370/751] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:09.990049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:09.997524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:09.998148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:09.998418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:09.998680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.006296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.007761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:10.020971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:10.023519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 382/752] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:10.024471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.110610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba63b-cad6-48c2-b80b-b192085f424c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.136162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38533-d93d-4dce-ab57-f327f452daa5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.147747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.148626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.149089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.149511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.150338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.150644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.152037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.161322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 371/753] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.162123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.175932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.176827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.177734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.178288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.179150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.180702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.194146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.198574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 383/754] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:10 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:10.199276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.247850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.308363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338ca01-1b9d-44e9-96c6-1646870379ef None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.343754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802177e-97ee-46e1-ba77-173261b9543e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.348520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.349247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.349594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.349924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.350720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=0dab0ca4926a45c0a0476bf3599161ef) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.351088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.352657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.360020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 372/755] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/role_assignments?user.id=0dab0ca4926a45c0a0476bf3599161ef&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.361044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.387743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.388760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.389302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.389932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.390912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.391457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.393337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.408055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 384/756] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.417752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.497571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.509297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:10.512603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562a56c-5151-4130-93e3-020358f3e5c2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.568113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.569109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.569590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.569715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b20d-d78b-4dab-bceb-a7bc9aa25466 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.570189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.591328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.593067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:10.610366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:10.611365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:10.612316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:10.612316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:10.612316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:10.612316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 373/757] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:10.613557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.614402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.614922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.615386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.616356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1192aab6e0444db1b006feb37c0fd3fa) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.616870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.617416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.618712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.626937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 385/758] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/role_assignments?user.id=1192aab6e0444db1b006feb37c0fd3fa&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.769044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326696b6-7049-4153-935f-2cd01d14e242 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.805533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:10.806156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:10.806442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:10.806712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:10.807362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:10.807702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:10.809047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:10.823693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 374/759] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:10.829296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:10.964427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7de14-615f-4205-82b1-218867389b6a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:10.999390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.010045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.010676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.010954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.011222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.019645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.021027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:11.033184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:11.034150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:11.035088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 386/760] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:11.040385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.043287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.148894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517d92-98d9-4e38-95be-21c12fdff3f0 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.197771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.198387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.198667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.198939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.199692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:11.200001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.201415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.222328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 375/761] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:11.227935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.342249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0d8dd-f218-4e4a-9f07-1c5580a08109 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.378930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.379616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.379865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.380139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.394375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.395887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:11.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:11.412411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:11.413286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:11.413286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:11.413286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:11.413286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 387/762] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:11.418173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.480709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.533059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737a92-53ad-4898-a21a-01e4436bf45c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.601330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.601869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.602145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.602410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.603060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:11.603357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.604789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfebfa-1d32-4955-9b37-e63bff80d862 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.624837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 376/763] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:11.630340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:11.715864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:11.771358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3a3-c069-4af2-b936-28c3ff661a61 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.771753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3a3-c069-4af2-b936-28c3ff661a61 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.772036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1b3a3-c069-4af2-b936-28c3ff661a61 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.777923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 377/764] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:11.783106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.783392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.783691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.799489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d312ac-7ee2-4f08-915a-db10c2669411 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:11.816341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:11.817554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:11.888193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:11.888834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:11.889106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:11.889906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:11.903973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 378/765] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:11.916765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:11.918223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:11.941144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:11.942071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:11.942948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:11.946535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 388/766] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:11.947798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:12.025410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.091378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14fe2f-fb2f-480b-9093-6d05e8d43b40 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:12.142549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:12.143071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:12.143344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:12.143644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:12.144339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:12.144639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:12.146054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:12.166890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 379/767] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:12.172523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:12.300172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.304158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7e2de-70e5-4a50-9669-beea516e5fcd None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:12.351081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:12.351762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:12.352043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:12.352318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:12.356700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=565774033b5d4aaab833757169efb547, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:12.358232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:12.373293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 389/768] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:12 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:53:12.511931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:12.653818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2af7c-ab70-4445-920e-df453abfe336 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:12.665793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:12.690895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:12.691561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:12.691845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:12.692116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:12.692707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:12.694064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:12.703704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:12.704750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:12.705624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 380/769] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Sep 7 12:53:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:12.716603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:12.850787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05184e9-b463-4fcc-bbf9-e781c9580289 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:12.897274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:12.897884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:12.898157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:12.898422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:12.899047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:12.899339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:12.900730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:12.911789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 390/770] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:12.916544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.074466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330c72-1fd3-43a2-9e03-7173e0042bed None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.129499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:13.130478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.130959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.131432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.132322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:13.132840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:13.134395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87cbbe-1e31-4622-b22f-0f3a8cfd5096 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:13.143641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 381/771] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:13.149619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.186292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.227704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a90190-8ae1-4a57-adb5-6096d7031241 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.228256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a90190-8ae1-4a57-adb5-6096d7031241 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.228256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a90190-8ae1-4a57-adb5-6096d7031241 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.229853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 382/772] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:13.235866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32caa94-30a1-4952-b2f6-e0cc124fc285 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.236209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32caa94-30a1-4952-b2f6-e0cc124fc285 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.236486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32caa94-30a1-4952-b2f6-e0cc124fc285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.256180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c32caa94-30a1-4952-b2f6-e0cc124fc285 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.257387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c32caa94-30a1-4952-b2f6-e0cc124fc285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.287879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8cfb3-b8e7-4866-a3dd-cd79c90c213d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.310283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.342151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:13.343836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.344326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.344941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.345989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] RBAC: Adding query filter params (interface=public, service_id=9fee8e9eab834b5fae50e05a8168f3a6, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:13.346498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:13.348212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:13.353966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 383/773] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:13.354834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf05-f23a-4e1a-9b66-cfccc9219420 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.355116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf05-f23a-4e1a-9b66-cfccc9219420 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.355384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf05-f23a-4e1a-9b66-cfccc9219420 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.356871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 384/774] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:13.358443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 391/775] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/endpoints?service_id=9fee8e9eab834b5fae50e05a8168f3a6&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:13.364810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2effda-56ec-472d-be0c-dfc97bfe1932 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.365100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2effda-56ec-472d-be0c-dfc97bfe1932 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.365368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2effda-56ec-472d-be0c-dfc97bfe1932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.366412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.388152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-fd2effda-56ec-472d-be0c-dfc97bfe1932 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.390211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fd2effda-56ec-472d-be0c-dfc97bfe1932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.486960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.489294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 385/776] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:13.499818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97b37-242a-4af8-8713-52f2c92e438b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.499818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97b37-242a-4af8-8713-52f2c92e438b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.501205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c97b37-242a-4af8-8713-52f2c92e438b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.505570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 386/777] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:13.518741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.518741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.518741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.526599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffb28-9e1e-4ff2-b76e-b762605aa839 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.558770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:13.560007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:13.575244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:13.575903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.576182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.576456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.578051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:13.579594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:13.587126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 392/778] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/services => generated 772 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:13.656505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 387/779] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:13.783926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.815805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:13.851683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:13.939402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c332bc-da99-43ea-97e9-e3ca98d19d7d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.977415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1cdb-f515-4ae2-aba8-4e3ff827a3a6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:13.981561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:13.982199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:13.982469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:13.982734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] PATH_INFO: `/v3/services/network` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:13.984377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:13.985506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:13.997047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:13.998069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:13.999499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 393/780] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.011340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.027449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.052214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.053684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.054174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.056318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.075059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:14.082598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.083601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:14.084433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:14.085077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 388/781] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.085887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.138468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dc748-52c1-47a4-8d88-ffb3a2d9c130 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.177469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.178494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.179009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.179518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.192331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:14.197570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.198492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:14.199319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:14.202291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 394/782] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:14.203412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.213372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.231336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bea55-aa42-44cd-8a47-05f781c0ed1b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.281091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.281529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.281813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.282086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.282721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.283026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.284504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.297092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.297092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.299180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.337010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dedfb8-63ea-4421-87af-ba1fc012e4ae None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.383660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.384528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.384804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.385070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.385727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.386025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.388581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.399120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 395/784] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.400047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.424779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554239-61ad-47db-bedd-f2a3fcfdb9c8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.463517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.464508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.465120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.465694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.466601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.467102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.469401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.479445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 390/785] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.480680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.501632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.538964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d631-4c68-4887-8bda-fdb73ec3b5aa None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.577549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.578557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.579038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.579650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.580541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] RBAC: Adding query filter params (type=network) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.581139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.582722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.585311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.595882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 396/786] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.597047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.605420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e4513-2e0a-43cb-92f0-c7e0dab22bda None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.648960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.649644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.649920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.650187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.665607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.667831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:14.688590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.689607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:14.690509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:14.690509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:14.690509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:14.690509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 391/787] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.691149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.722055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac6d6d-4fde-4151-ae6a-7473c2313d08 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.768648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.772158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.773342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.773683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.774018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.789273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.791515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:14.812912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:14.813935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:14.814876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:14.814876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:14.814876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:14.814876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:14.820711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fb086-4b85-43de-a775-c8aa38b571f6 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.820907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.860521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.861136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.861414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.861738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.862430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] RBAC: Adding query filter params (interface=public, service_id=392091dfdffa42ac8e332f1602bb5114, region_id=RegionOne) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.862740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.864615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.879343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/endpoints?service_id=392091dfdffa42ac8e332f1602bb5114&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:14.880289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:14.890452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:14.950026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee4d41-ffa7-4b5c-8cb6-f9279be6ff5b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:14.989341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:14.990141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:14.990419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:14.990685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:14.991520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:14.992127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:14.993762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:14.994500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaa25d-22c1-49be-a1a8-dab0c918950a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.008010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 398/790] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.008810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.029140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.036563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.037299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.037578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.037850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.038491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:15.038793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.040534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e88e5-07e4-4af4-82fe-9f20d41733dc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.055718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.063787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6dd-46d1-47e2-9ca7-13cb9d5acde0 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.063787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6dd-46d1-47e2-9ca7-13cb9d5acde0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.063787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6dd-46d1-47e2-9ca7-13cb9d5acde0 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.063787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 394/792] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:15.063787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad6dd-46d1-47e2-9ca7-13cb9d5acde0 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.129372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d86c2-c425-4255-a1d4-62c41ed2da90 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.143748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.168849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.169550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.169821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.170098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.172051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.172681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.174053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad6dd-46d1-47e2-9ca7-13cb9d5acde0 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.183502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 399/793] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.183502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.222226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.222523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.222768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.223000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.232598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.234053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-5395400c-372f-460d-934d-d5f934a261fa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:15.246844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:15.247861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:15.249980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 395/794] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:15.250581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.250581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.250991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.271562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:15.272718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:15.317816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2749fa-b825-411d-a449-5e667507e8a3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.328669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.358422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 396/795] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:15.358619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.369961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.371074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.371579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.372136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.392807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.394611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:15.416052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:15.417062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:15.418332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 400/796] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:15.428727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.484246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.491183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2732c2-01d6-449f-becb-4cdcfc00a369 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.555160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.555800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.556077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.556346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.557080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:15.557382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.558802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.594200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 397/797] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:15.598158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.619191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850919b3-1721-4983-bb2e-65a4ba0a510f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.657225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.657839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.658114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.658382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.659109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:15.659411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.660873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.679647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.698105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 401/798] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:15.698948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.756805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf154db-4c1f-4f54-ad53-917aa78c2ae5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.794845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.796084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.796494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.797064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.808515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.810516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.810955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:15.819064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa2e0-f645-472e-a4bb-58cd5b232ca0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:15.828163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:15.830325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:15.832498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:15.832498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:15.832498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:15.832498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 398/799] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:15.832498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.857447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.858838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.859121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.859393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.871112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:15.876662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:15.878800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:15.880751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:15.887514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 402/800] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:15.887514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:15.931316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:15.943254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38b38-069d-4a29-91ec-5d91017f0367 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:15.982878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066188-d186-4c04-852d-acc22249d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:15.984146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066188-d186-4c04-852d-acc22249d760 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:15.984421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066188-d186-4c04-852d-acc22249d760 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:15.984692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05066188-d186-4c04-852d-acc22249d760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:15.997047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05066188-d186-4c04-852d-acc22249d760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:15.998429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05066188-d186-4c04-852d-acc22249d760 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.006709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16903a5-9b1a-4a54-a333-c03ed18d4c90 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-05066188-d186-4c04-852d-acc22249d760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:16.014608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:16.015737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:16.016632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:16.016632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:16.016632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:16.020647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 399/801] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:16.021600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066188-d186-4c04-852d-acc22249d760 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.048262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.049151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.049611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.050054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.050887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.051272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.052682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.066911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 403/802] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.068103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.089968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.130921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05066188-d186-4c04-852d-acc22249d760 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.167563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.168227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.168509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.168780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.169446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.169751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.171702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1554c-a67a-495c-8cf0-76e50524b2d1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.183722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd77c5-1f2a-4853-9ee4-c6637c0dda2e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.185233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 400/803] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.187407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6416-2336-43db-a6e3-57645ecbba55 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.187901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6416-2336-43db-a6e3-57645ecbba55 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.188181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d6416-2336-43db-a6e3-57645ecbba55 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.191580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 401/804] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:16.191580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d6416-2336-43db-a6e3-57645ecbba55 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.196580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.224538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.225144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.225421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.225688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.226319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.226618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.228014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.243010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 404/805] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.243929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.307874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d6416-2336-43db-a6e3-57645ecbba55 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.325807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.345253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.345881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.346152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.346422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.354033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.355492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.355845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53c1c-4d05-45d9-8223-c6194aa5229a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.394646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.395306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.395623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.395941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.410560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.412201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-cb3d8448-3a82-436e-8208-a3bc47864dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:16.429108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:16.430118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:16.431016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:16.431016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:16.431016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:16.435602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 405/806] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:16.437753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.438033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.438305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.457945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:16.459162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:16.486051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:16.487012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:16.487913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 402/807] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:16.488400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.543354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 406/808] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:16.544237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.568630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.622185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed901-fbb3-46d9-b081-1e0f978e0171 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.624328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.672016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.673358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.674028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.674442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.682490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634338f0-f928-4009-8d2f-baf1a1ffc559 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.683574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.687251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:16.701500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:16.703014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:16.704332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:16.711774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 403/809] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:16.712773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.728695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.729758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.730147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.730527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.731604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.732010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.733967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.755894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 407/810] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.758388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.849413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5febe53-9360-4f4d-924b-f587f24636f2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.872808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.884772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.885381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.885658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.885926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.886245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb811-fb24-4617-8b6a-969ac57eb24e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:16.886682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.886900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.888338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.900808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 404/811] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.904644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:16.904805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:16.925273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:16.925991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:16.926270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:16.926539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:16.927222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:16.927560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:16.928995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:16.942381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 408/812] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:16.943027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.012998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd445122-1904-4d54-92fb-84b4e837d815 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.052648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.054264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.054543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.054814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.054977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03bc50-c1ae-4e33-bc89-2cf7b0d356c0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.065864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.067310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:17.085295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:17.086486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:17.087427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 405/813] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:17.088071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.099753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.100730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.101153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.101567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.102350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.103931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:17.114597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:17.115844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:53:17.116891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:17.119298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 409/814] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Sep 7 12:53:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:17.120254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.144008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.166231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.203643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d880-d519-4d60-bd47-4c9f00414191 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.237419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55451ddd-2c6b-4d25-aa7e-503b14dc652c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.240102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.240836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.241116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.241380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/0dab0ca4926a45c0a0476bf3599161ef/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.257347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=0dab0ca4926a45c0a0476bf3599161ef, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.258761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.272753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 406/815] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:17 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/0dab0ca4926a45c0a0476bf3599161ef/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:17.273607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.285532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.286684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.287223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.287531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/1192aab6e0444db1b006feb37c0fd3fa/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.289574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=1192aab6e0444db1b006feb37c0fd3fa, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.291087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.310632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 410/816] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:17 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/1192aab6e0444db1b006feb37c0fd3fa/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:17.312154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.420147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.447711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a6df9-2f09-4513-a42b-55ec1a892d35 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.489457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.493605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd5f-530d-42f2-ab57-06d24fd23b45 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.537272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.538782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.539153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.539826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.540755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:17.541327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.543704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.554632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.555259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.555559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.555839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.556488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:17.556797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.558237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.572892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 411/818] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.573979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 407/818] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.580126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.584227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.706645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dc016-2582-4bbd-95f0-8f04122d62a3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.713557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23346c0-a7e8-4875-be79-e84636ef73f4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.754127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.754514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.754913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.755123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.755233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.755392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.755698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.755799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.756421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:17.756786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.758315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32878d2-9f44-4e82-bf97-782ced8f74f0 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.764510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 408/819] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:17.765918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69b96c-32c5-47f8-832e-c5ee9c12d642 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.766357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69b96c-32c5-47f8-832e-c5ee9c12d642 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.766698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69b96c-32c5-47f8-832e-c5ee9c12d642 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.768372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 409/820] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:17.773457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69b96c-32c5-47f8-832e-c5ee9c12d642 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.794450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.799145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:17.846698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.849035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.900453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69b96c-32c5-47f8-832e-c5ee9c12d642 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:17.947721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:17.948336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.948620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.949332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:17.950027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:17.952144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83250-4478-4eca-affe-3c7d1c6d902e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:17.981029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 410/821] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:17.981792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 412/822] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:17.982382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:17.982739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:17.983452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:17.983705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.006971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:18.008224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:18.080687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.099622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.114161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 411/823] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:18.166517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaea964-0fb2-4912-87e9-a3d04612ed1d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.224061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.224718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.224998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.225264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.240380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.241771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:18.262370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:18.265350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:18.267482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:18.267482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:18.267482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:18.267482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 413/824] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:18.271512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.384928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268585a-b6ae-45f0-bf95-a275d82e7aec None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.423417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.424189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.424349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.424552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.425206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:18.425559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.426854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.441898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 412/825] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:18.447494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.495605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.580108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d5bc8-f990-4ba8-a596-e57ffbb6c815 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.586960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.602402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.624162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.624786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.625055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.625317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.632922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.634464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.646346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f290d-d710-4ced-9eaf-2d151bb1a546 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:18.652636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:18.653619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:18.654506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 414/826] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:18.665842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.715859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.716498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.716773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.717038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] PATH_INFO: `/v3/services/network` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.718471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.719871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:18.737616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:18.738644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:53:18.739493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:18.740785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 413/827] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:18.744709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.847198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a949a-6e58-416a-b5b6-1ff879839c51 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.871264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693636a0-c0b9-4c57-82e5-920133579472 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:18.883822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.884729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.885211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.885654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.886521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:18.886995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.888637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.903962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:18.907721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:18.908419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:18.908807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:18.909125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:18.909821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] RBAC: Adding query filter params (name=network) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:18.910190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:18.911705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:18.919825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 415/828] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:18.921497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.922182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 414/829] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:18.927705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:18.997790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:19.050292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce8ec-ef92-42cc-8860-271f541b6196 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.080864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97410-2ea5-4120-b574-0b82ed891eac None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.087414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.088333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.088810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.089278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.090110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] RBAC: Adding query filter params (type=network) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:19.090619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:19.092180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:19.104191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 415/830] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:19.110141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:19.166117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.167253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.168331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.169013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.171254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:19.172238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:19.177873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d93516-5966-4a48-b8a6-0b4cd2658dc1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:19.195836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 416/831] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:18 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:19.207741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:19.301461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1530d80-a4a9-49e5-8bc4-5b27449e5911 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:19.349154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:19.350191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.350735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.351205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.352119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:19.353726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55040642-8844-49ca-b49c-17f216ba1d0a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:19.382614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 416/832] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:19.914140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924af2-7f9f-45b7-ba65-6df12bcb4853 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.914486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924af2-7f9f-45b7-ba65-6df12bcb4853 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.914688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924af2-7f9f-45b7-ba65-6df12bcb4853 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.916337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 417/833] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:19.922233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.922678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.922853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.942700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:19.943940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:19.997302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8a8-c6c1-4e18-9ff4-63c14bf0c9e4 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:19.997632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8a8-c6c1-4e18-9ff4-63c14bf0c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:19.998750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8a8-c6c1-4e18-9ff4-63c14bf0c9e4 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:19.999551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 418/834] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:20.004806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.005092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.005430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.024896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:20.025593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 417/835] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:20.031523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:20.102499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 419/836] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:20.295943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.331140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.385501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.406380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204d83-64bf-47ae-8303-e16220a72a24 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.417727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.453528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.454189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.454467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.454927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.469273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:20.477031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:20.478142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:20.478983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 418/837] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:20.484240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.502827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d806ff-8363-4518-8849-4ef8c5b61483 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.552411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.553196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.553492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.553754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.565849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:20.571009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:20.571937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:20.572792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 420/838] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:20.578667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.596531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.607165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98311a0-c219-4a86-a7f6-181bf0b6b828 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.651546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.652441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.652785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.653058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.654040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:20.654348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.656014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.671640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 419/839] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:20.675339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.697200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.708743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dfb51-6305-485a-aaa5-625fac21bed1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.754385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.755010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.755283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.755580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.756708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:20.757011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.758745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.770855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 421/840] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:20.776791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.808325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b1d7-dd93-44d7-b599-6f36aa03e0c1 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.866127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.866759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.867050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.867582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.884483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.886474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f82c57cc-717e-43c7-963c-4f5934d9ec4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:20.902648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:20.904234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:20.905462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:20.905462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:20.905462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:20.905462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 420/841] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:20.905705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e460-0db6-4fb0-a820-12eb0b3d47d2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.906133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e460-0db6-4fb0-a820-12eb0b3d47d2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.906232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e460-0db6-4fb0-a820-12eb0b3d47d2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.907594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 421/842] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:20.912203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e460-0db6-4fb0-a820-12eb0b3d47d2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:20.923610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:20.926801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce94a-e0d9-44c3-b98b-c8cd38e06d8e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:20.964981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:20.965611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:20.965891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:20.966164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:20.977601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:20.979053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c606b1e0-a02c-47bc-9eaf-334b00446917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:20.994851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:20.995874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:20.996759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:20.996759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:20.996759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:21.001502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 422/843] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:21.002567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.002859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.003133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.011620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.024630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:21.025808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:21.030997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e460-0db6-4fb0-a820-12eb0b3d47d2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.071220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.071793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.072100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.072345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.072983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.073282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.074631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.087270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.092902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.103735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 423/845] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:21.104875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.187377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.222088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844452-1f0e-4ea4-afd8-00b7988aaafc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.236077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be601374-6d98-45dd-8c36-e8ff959fef49 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.271057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.272269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.272774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.273167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.273486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.273773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.274052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.274322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.274967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.275270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.276693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.276816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.286324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.288980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.295300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 423/846] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.296995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:21.304369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:21.305366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:21.306371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:21.308678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:21.314442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.418497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335a06-ce94-4ebf-b898-ea5d805a614b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.442892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368caa4a-3169-49a2-a9ae-edfa2a25e37c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.447353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.457886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.458522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.458793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.459064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.466924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.469264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:21.481576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:21.482552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 424/848] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:21.484383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.488781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.489385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.489658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.489923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.490649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.490948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.492393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.510801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 425/849] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:21.516852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.577279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.604819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8237553-994c-473b-91bd-a46effd9f911 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.629926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dff11b-b20e-4fe3-bbc9-03cac6344326 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.641568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.642198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.642475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.642740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.643316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.644926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:21.654710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:21.656712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:21.657556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 425/850] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:21.658872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.672041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.672659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.672937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.673209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.673954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.674256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.675760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.700866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 426/851] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.700866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.721056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.777305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5b6df-12f0-45d3-a13d-e5c0c57e8dc4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.809574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc792cf-4396-4d9a-9b4c-9c5e53d1d432 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.813617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.814240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.814513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.814785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.822222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.847719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.848319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.848595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.848866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.849484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:21.849790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.851209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.860206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 427/852] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:21.860206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.886537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:21.888005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417816c1-0539-4a8d-93e6-8be1e277fb08 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:21.938464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:21.959731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c1a9-8f92-4866-9483-783e178cbfc5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:21.988647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 426/853] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:21.989905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fabc0-e8d0-470e-9d45-44387f57b550 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.990188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fabc0-e8d0-470e-9d45-44387f57b550 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.990462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fabc0-e8d0-470e-9d45-44387f57b550 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:21.993837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 427/854] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:21.993837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fabc0-e8d0-470e-9d45-44387f57b550 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:21.994781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:21.995440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:21.995955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:21.996240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.039388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.065530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.066979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb225d7-9e5e-4d1a-b749-c9f4d776784e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.097011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fabc0-e8d0-470e-9d45-44387f57b550 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.132039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.132639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.132918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.133193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.133817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:22.134116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.135486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.140717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 428/855] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:22.141496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.174775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 428/856] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:22.174775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.174775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.174775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.181495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.193130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:22.194277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:22.274386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 429/857] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:22.275658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.287352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.292808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24e18-0496-477e-9c13-8c8468aa9c4a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.337368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.337999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.338272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.338540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.351633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.355691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:22.370669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.371727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:22.372597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:22.372597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:22.372597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:22.372597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 429/858] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:22.378536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.412871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677d4d3-2932-4797-8d80-9926ab476061 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.457800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.460390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.461706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.462148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.463055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.477106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.479068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.501429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d083a8-d4a5-4753-8f9a-cd2dff88b53a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:22.502137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.503206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:22.504316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:22.504316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:22.504316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:22.507118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 430/859] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:22.515511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.543697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.544478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.544886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.545231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.546452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:22.547011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.548745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.566320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 430/860] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:22.567251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.586319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.638893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf170-41f5-4f99-9067-36c4445072e1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.677266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.677867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.678141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.678414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.679041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:22.679361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.680617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad7-f14b-426e-9775-0646cbb2db7a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.680807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.696374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 431/861] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:22.697060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.717048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.728434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.729055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.729328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.729617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.730187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.731504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.741294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.742288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:22.743188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 431/862] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:22.744061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.822118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e5cf-d12d-41ff-b9ff-31fbfc7be5e1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.841221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:22.854859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d51a7-f540-43bd-b0b1-e58288197be5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:22.863576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.864199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.864471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.864736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.872105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.873572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:22.884869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.885830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:22.886727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:22.890712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 432/863] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:22.891572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.893745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:22.894152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:22.894425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:22.894688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:22.902440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:22.903906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:22.917364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:22.918299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:22.919178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:22.919646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 432/864] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:22.921111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:22.978046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.006143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29ee98-3be9-4449-96fd-3bb6320f91e0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.033674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e027d-4323-4954-8a41-a79e00fc60a4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.042167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.043055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.043055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.043318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.043968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.044266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.045751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.050753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 433/865] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.051362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.077670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.078296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.078645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.078832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.079569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.080176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.081330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.099515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.100170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 433/866] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.100947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.161108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f955577-2296-4406-af70-56f19776eeaa None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.198002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.198740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.198948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.199220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.199958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.200259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.202594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.210322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dbab9-85e6-4fa7-a9d0-bba2ff4e2ccc None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.220700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 434/867] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.220700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.222723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.252838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.253601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.254135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.254424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.255054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.255359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.257834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.271625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 434/868] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.271625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:23.333898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:23.338122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1688bef-14f1-491c-85eb-f01f7404cfa4 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.378916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.379689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.380094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.380442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.381332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=0dab0ca4926a45c0a0476bf3599161ef) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.381713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.383339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a577b-6a91-49e8-9412-48b4e616dc00 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.394944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 435/869] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/role_assignments?user.id=0dab0ca4926a45c0a0476bf3599161ef&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:23.408563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882284a-0f13-4712-b5c2-834468da825d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:23.456236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:23.457290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:23.457796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:23.458268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:23.459254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=1192aab6e0444db1b006feb37c0fd3fa) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:23.459819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:23.461815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa552a7a-f829-4b90-9460-6c4214f905d2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:23.470138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:23 2022] GET /identity/v3/role_assignments?user.id=1192aab6e0444db1b006feb37c0fd3fa&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:24.425491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd15c5-257d-4090-aadf-7ef038b80e25 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.426037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd15c5-257d-4090-aadf-7ef038b80e25 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.426037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd15c5-257d-4090-aadf-7ef038b80e25 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.427650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 436/871] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:24.433180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a276-ef58-457d-8eaf-da475fdf0e01 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.433577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a276-ef58-457d-8eaf-da475fdf0e01 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.433751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a276-ef58-457d-8eaf-da475fdf0e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.453520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-68c3a276-ef58-457d-8eaf-da475fdf0e01 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:24.454702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-68c3a276-ef58-457d-8eaf-da475fdf0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:24.486901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:24.538034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 436/872] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:24.817342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd15c5-257d-4090-aadf-7ef038b80e25 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:24.927075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd15c5-257d-4090-aadf-7ef038b80e25 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:24.962955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:24.963589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:24.963866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:24.964134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:24.964779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:24.966131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5482-3c25-43a1-930b-7b374efb6834 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:24.981685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 437/873] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:24 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:25.541911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d27d-8507-484d-ae2c-51f4ee5abdd1 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.542439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d27d-8507-484d-ae2c-51f4ee5abdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.542439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d27d-8507-484d-ae2c-51f4ee5abdd1 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.544032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 437/874] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:25.549718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099069e2-f740-4b82-be56-015827cc8c26 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.550180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099069e2-f740-4b82-be56-015827cc8c26 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.550267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099069e2-f740-4b82-be56-015827cc8c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.570572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-099069e2-f740-4b82-be56-015827cc8c26 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:25.571794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-099069e2-f740-4b82-be56-015827cc8c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:25.591229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:25.662964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 438/875] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:25.738035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c38b-17d9-4435-a2c7-f15ea40bf08e None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.738362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c38b-17d9-4435-a2c7-f15ea40bf08e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.738567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66c38b-17d9-4435-a2c7-f15ea40bf08e None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.740479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 438/876] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:25.741186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38b31e-4f44-4b24-839b-0fe9a20b7250 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.741558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38b31e-4f44-4b24-839b-0fe9a20b7250 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.741831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38b31e-4f44-4b24-839b-0fe9a20b7250 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.743251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 439/877] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:25.745181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.745467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.745741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.748279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:25.749302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:25.749750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:25.765400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:25.766609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:25.770660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:25.771089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:25.839843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 439/878] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:25.854781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 440/879] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:25.950277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.049959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.056127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf27b9-a780-4d3f-8d69-e2873b889a05 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.091725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.093129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.093551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.093824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.094470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.095835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.112671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 440/880] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:25 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:26.129593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.132674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.225508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.249880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb14-4774-4fc2-9b6f-c45493f37ee4 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.297638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160f99d-c39e-4966-9e1d-e1749a6e146b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.298091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.298727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.298999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.299309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.299862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.301699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:26.310402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:26.312336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:26.313349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 441/881] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:26.318504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.342752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.344173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.344173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.344359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.359501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:26.367136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:26.368315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:26.369346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:26.372924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 441/882] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:26.380825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.404067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.457172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7611d5-2bba-4832-bc76-a441647fa1d3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.496410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.497076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.497294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.497563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.498193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:26.498527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.499985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.505570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 442/883] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:26.510900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.515366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.523760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710acf9b-0be0-4252-ba8b-ce1a80904510 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.573494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.575406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.576210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.576739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.577883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:26.578808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.580988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.594912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 442/884] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:26.601275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.629764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df0460-2ec6-45ea-aded-66e891712d9d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.666840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.667432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.667745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.668017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.668717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:26.669024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.670858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.676275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 443/885] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:26.693983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.716577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f9637-a359-48af-9842-50d1790fb692 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.764051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.764770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.765048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.765313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.778039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.779571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:26.797687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:26.798772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:26.799688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:26.799688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:26.799688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:26.799688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 443/886] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:26.804912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:26.882155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:26.925197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cab95-70e9-4b3f-bd63-f1b559d1f572 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:26.961799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:26.962407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:26.962681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:26.962947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:26.963610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:26.963907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:26.965707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:26.980263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 444/887] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:26.986406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.096426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2923b3-985f-4f31-b356-2842c0830d83 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.129124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.137788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.138462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.138748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.139117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.146961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.148468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-d485d55b-9051-465d-9200-5a46058e7c6d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:27.160575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:27.162714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:27.165020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 444/888] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:27.168755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.281530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327fe77-1733-4752-89ff-fa50986b5fd1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.312196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.320672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.321264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.321537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.321808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.322530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:27.322828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.324636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.329761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4994-e95c-4a9d-ad51-9a61ae2771df None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.330043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4994-e95c-4a9d-ad51-9a61ae2771df None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.330315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba4994-e95c-4a9d-ad51-9a61ae2771df None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.333020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 445/889] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:27.336996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.337274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.337540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.344693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 445/890] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:27.350498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.361262 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:27.362501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:27.439700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 446/891] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:27.457419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c3b2-31bb-419a-946b-ee3f398916ba None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.492432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.493165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.493438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.493706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.555881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.567406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.569184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.677342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 446/892] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:53:27.684932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.721196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.796759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceecc0c-f06f-4dcb-b2f7-a2fab4d025b3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.818759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.838117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.838746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.839034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.839281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.840946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:27.853187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.854572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.860201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993149-9ed2-4b5a-80c7-7f90a510222d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:27.870520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:27.871522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:27.872399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:27.872399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:27.872399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:27.876608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 447/893] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:27.878191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:27.909919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:27.911436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:27.911937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:27.912619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:27.913630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:27.915901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:27.928162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:27.929196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:27.930000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:27.936516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 447/894] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:27.940207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.008266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c6b1e-31ac-4bdc-ab23-0bc6dd73e1f4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.049274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.050269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.050845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.051340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.052377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.052917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.054572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.072854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 448/895] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:28.073324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b4b23-371f-45cb-a83f-e0f581af9672 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.074406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.110651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.117512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.118124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.118410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.119479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.120151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.120459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.121858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.127548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 448/896] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:28.132162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.152825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.202640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3ff41-b649-4c8e-b91b-73e3be96c499 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.244405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.245443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.246005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.246567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.254361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.256213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.260385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848d105-f31c-49d2-a780-ca6b6bc48ab6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:28.270009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:28.270912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:28.271814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:28.279014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 449/897] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:28.281192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.299993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.300611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.300883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.301150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.301777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.302073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.304238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.315546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 449/898] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:28.317368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.399329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.410329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18f47a-2811-4f89-b5e9-5bb0430c80ef None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.418408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.444738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b53d2-63c1-42eb-8eed-816374e584e0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.451946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.453013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.453448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.453873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.454856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.455303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.456990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff232c-c7eb-4941-ada9-29fd9ba3cd5e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.476202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 450/899] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:28.477400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81c17-9c2e-4423-8176-f53f25c3b558 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.477695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81c17-9c2e-4423-8176-f53f25c3b558 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.478059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f81c17-9c2e-4423-8176-f53f25c3b558 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.479512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 451/900] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:28.480040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f81c17-9c2e-4423-8176-f53f25c3b558 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.480963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.481572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.481850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.482125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.482856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] RBAC: Adding query filter params (interface=public, service_id=bc56625441a747a0803c7700757fd47f, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.483164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.484882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3470e-c962-405f-98ee-7a9eeed06371 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.494274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 450/901] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/endpoints?service_id=bc56625441a747a0803c7700757fd47f&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:28.495771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.496138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.496477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.515044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:28.516196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:28.591078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 451/902] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:28.597051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.610906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f81c17-9c2e-4423-8176-f53f25c3b558 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.651042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.652091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.652569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.653033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.654023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] RBAC: Adding query filter params (role.id=532210c582834e99a09783449276300b, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=0dab0ca4926a45c0a0476bf3599161ef) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:28.654563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.656443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.668283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 452/903] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/role_assignments?user.id=0dab0ca4926a45c0a0476bf3599161ef&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=532210c582834e99a09783449276300b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:28.690739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.728131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29013-71b5-4da9-8df2-f5bc44f2c23e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:28.769769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:28.771159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:28.771159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:28.771159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:28.771571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:28.775493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091985a2-8f15-4ac2-b768-04c7a75c720d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:28.779753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 452/904] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:53:28.862254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:28.881064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:28.990115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f510c-ab71-4e60-a7e2-decfc458f0c4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.026311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534e62-1cb5-4a25-a85b-401a48d4f77a None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.026602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534e62-1cb5-4a25-a85b-401a48d4f77a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.026770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1534e62-1cb5-4a25-a85b-401a48d4f77a None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.027344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.028279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.028399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 453/905] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:29.028474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.028631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.029199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.030956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.035433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.035745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.036013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:29.040659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:29.041582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:29.042488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 453/906] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Sep 7 12:53:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:29.048260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.063237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:29.064734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:29.138211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 454/907] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:29.155844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:29.172317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08d61-a14d-48af-81b3-6b3490a56e20 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.212307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.212912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.213187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.213458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.214086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:29.214429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.215929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.222053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:29.232386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.304102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:29.341207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59674d1-275e-449d-9baf-02f004e5e513 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.381204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.381819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.382098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.382374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.383006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:29.383312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.384728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.390279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:29.396101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.430272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.518914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3681c9-8048-4a4c-9367-bf3a10ec2dcb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.544332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285fd0-bd14-4466-bb5c-262730bf7a1f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.569434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.570195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.570472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.570739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.571883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] RBAC: Adding query filter params (interface=public, service_id=9393722e297c40faa06a7a11d9bc4a8b, region_id=RegionOne) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:29.572192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.573847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.577666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:29.583542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 455/910] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:29 2022] GET /identity/v3/endpoints?service_id=9393722e297c40faa06a7a11d9bc4a8b&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:29.588341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:29.590655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.591365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.591679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.592490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.593381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.594826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55638a5d-8d4d-46b5-b764-dc0d8381a229 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.601307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:29.619849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 456/911] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:29 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:29.712276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55cd3b-3a61-40e4-b969-7e34ad0851ee None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:29.756231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:29.756839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:29.757111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:29.757372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:29.757971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:29.759402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a03b-f4a1-41e1-99be-8f4866c4ba80 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:29.767040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 456/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:29 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:53:30.917880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa1fe-ecd2-448a-89c5-898b1eefc0f2 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.918415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa1fe-ecd2-448a-89c5-898b1eefc0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.918415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa1fe-ecd2-448a-89c5-898b1eefc0f2 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.920814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 457/913] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:30.926058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a737-28f3-4e1f-b471-4627d1382b7b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:30.926898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a737-28f3-4e1f-b471-4627d1382b7b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:30.927365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273a737-28f3-4e1f-b471-4627d1382b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:30.947296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f273a737-28f3-4e1f-b471-4627d1382b7b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:30.948862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f273a737-28f3-4e1f-b471-4627d1382b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:31.012727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.020700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 457/914] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:31.178084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000068e7-960d-41d5-a2ed-db45b4e83e05 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.178381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000068e7-960d-41d5-a2ed-db45b4e83e05 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.178571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000068e7-960d-41d5-a2ed-db45b4e83e05 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.180151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 458/915] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:31.189563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.189948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.190316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.208691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:31.209861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:31.277891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 458/916] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:31.300110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000068e7-960d-41d5-a2ed-db45b4e83e05 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.408513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000068e7-960d-41d5-a2ed-db45b4e83e05 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.448970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.449958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.450522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.451004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.462758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:31.468779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:31.469679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:31.470539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:31.473175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 459/917] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:31.481025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.573589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.611031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd5b58-3551-4304-8cca-b9d9b699996a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.630630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.649612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.662595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.663364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.663790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.664058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.664720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:31.665245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.667075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.677748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 459/918] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:31.682944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.686276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0682a-c573-4ec0-8e31-b8bcf2874a8f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.722955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.723557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.723837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.724288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.725630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.727040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:31.738339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:31.739359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 12:53:31.740240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:31.740983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 460/919] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:31.745616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.815894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f727f96-dc01-4eb4-95cb-5cb597fd475f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.857339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.858746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.859052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.859328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.873260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.876146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.885761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb35d5c-eece-43c0-a183-eb32f9698d95 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:31.897759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:31.898785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:31.899725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:31.899725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:31.899725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:31.904324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:31.906685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 460/920] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:31.907760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.932693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:31.934361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:31.935187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:31.935659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:31.936429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:31.937385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:31.939667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:31.951956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 461/921] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:31.954434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:31.960977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.024818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943c22-bfe9-41d9-952e-79c65ba54d3f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.058784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.059383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.059722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.059867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e072f0-f6af-4edb-a7cf-5d7fc2d6ef67 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.060019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.060709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.061574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.063277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6f9ad-c57b-467e-8190-786b482940ab None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.074869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 461/922] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.076073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff28d1-2120-4190-a421-8769b79b3add None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.076422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff28d1-2120-4190-a421-8769b79b3add None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.076846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff28d1-2120-4190-a421-8769b79b3add None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.078121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 462/923] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:32.079135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4f1e6-b4af-4beb-bd33-997b64ef8613 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.079404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4f1e6-b4af-4beb-bd33-997b64ef8613 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.079690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4f1e6-b4af-4beb-bd33-997b64ef8613 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.080858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 463/924] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:32.081534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4f1e6-b4af-4beb-bd33-997b64ef8613 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.100273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.100886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.101166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.101437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.102065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.102364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.103752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38ea99-d73c-4eb7-a2dc-978cae23b919 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.109619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 462/925] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Sep 7 12:53:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.111047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1908-3254-4cf2-bd73-a14283d8d152 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.111382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1908-3254-4cf2-bd73-a14283d8d152 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.111818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1908-3254-4cf2-bd73-a14283d8d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.130010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8a2b1908-3254-4cf2-bd73-a14283d8d152 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:32.131208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8a2b1908-3254-4cf2-bd73-a14283d8d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:32.165199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.185649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.191495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4f1e6-b4af-4beb-bd33-997b64ef8613 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.199918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 463/926] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:32.201145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.201424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.201691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.219685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:32.220921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:32.237001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.237625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.237898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.238164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.245684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.247137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:32.262128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:32.263220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:32.265060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.308981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 464/928] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:32.310157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.397021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f1f6-1fb4-4beb-b812-c3f56ca60ef5 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.439438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.440480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.441008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.441483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.442385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.443656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3642c04-3e9a-4861-91d6-03cffa50f85b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.444232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.445217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.472213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 465/929] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:32.474338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.507854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.536247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.537194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.537810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.538249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.540585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.541115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.544717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.593770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.595838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.623953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386ce91-e28b-4137-aea3-62b17fae2337 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.665905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.666558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.666838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.667110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.667839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.669232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:32.682365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:32.683588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:32.684593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.688097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 466/931] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:32.689249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.728154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545acde0-af46-4b12-914a-b4cba41014db None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.773277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.773997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.774272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.774552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.786059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.787551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.789627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:32.803859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:32.804839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:32.805715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:32.805715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:32.805715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:32.805715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 466/932] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:32.805715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.816963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd0b4b-f3a5-4eb1-a6a2-397801c83c05 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.820932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:32.857226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.858504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.858828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.859094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.859715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.861288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:32.871252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:32.872391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 12:53:32.874140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:32.877780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 467/933] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:32.878837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:32.921032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e74e5a-fe93-4a34-8f92-097a8723b976 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:32.958042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:32.958706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:32.959017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:32.959285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:32.959942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:32.960242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:32.961594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:32.966302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:32.967289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.001129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe63667-40f4-4ae1-bb9d-22c7ec6c7126 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.049934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.052742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.053510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.053785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.054048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.054694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.054987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.056603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.071333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.072809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.077164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.085888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28aab-46f6-4d2e-9d12-ca841d66d227 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.125437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.126051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.126331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.126600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.127233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.127559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.128921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.138128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.138128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.192767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7424ed-1b2a-42c4-ac57-8492bc646ba8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.230672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.231292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.231593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.231860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.232500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.232831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.234254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.243710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.243710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.248816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16417e4c-631b-4749-bbb1-3f5e99e4693d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.285762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.286528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.286668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.286910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.290008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.294517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.296912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:33.309813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:33.310844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:33.312049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 469/938] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:33.312535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.317389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.356428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1cb9d-a5c4-419d-939c-1b266bc2b6bc None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.396652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.397527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.397813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.398081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.398844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.399142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.400527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.405961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 470/939] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.406735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.422603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0aea6-63a1-49d2-a8de-d2ea9bda2b61 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.465840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.466498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.466710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.467684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.468546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] RBAC: Adding query filter params (interface=public, service_id=be666797f4c748e59585b8c12ea812fb, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.468847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.470215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.479877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 470/940] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/endpoints?service_id=be666797f4c748e59585b8c12ea812fb&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.479877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.519608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e19de-6640-4c0f-8063-7c66e0dc80f2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.542584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.551686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.557389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.558135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.558311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.558535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.559225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:33.559556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.561109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.574170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 471/941] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:33.577291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.588242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1c48-e837-4843-a229-54dd539884ad None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.625741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.626348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.626681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.626960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.627700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.629303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.652719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 471/942] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:33.653437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:33.698936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a1625-deb8-4fd6-acb4-5527af4b0ce2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.762155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.762998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.764435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.764839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.765556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.767861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019810b-6d17-406e-a396-855f566ef864 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.780222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 472/943] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:33 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:53:33.800148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1370-56d5-4c99-8f7c-a210ebe00422 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:33.823405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:33.847582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:33.848259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:33.848532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:33.848899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/0dab0ca4926a45c0a0476bf3599161ef/roles/532210c582834e99a09783449276300b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:33.851177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=0dab0ca4926a45c0a0476bf3599161ef, role_id=532210c582834e99a09783449276300b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:33.852758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e60f7-0601-4be6-85f2-891c4d86aab6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:33.869542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 472/944] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:33 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/0dab0ca4926a45c0a0476bf3599161ef/roles/532210c582834e99a09783449276300b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:34.879276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc357-5e4d-4fd5-a916-c2d6db83e21f None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.879809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc357-5e4d-4fd5-a916-c2d6db83e21f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.879887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbc357-5e4d-4fd5-a916-c2d6db83e21f None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.881423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 473/945] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:34.886888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:34.887276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:34.887443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:34.906444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:34.907658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:34.983575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 473/946] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:35.256090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbc357-5e4d-4fd5-a916-c2d6db83e21f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:35.315525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:35.370689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbc357-5e4d-4fd5-a916-c2d6db83e21f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.414524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.415548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.416052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.416539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.417482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.419165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.422407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING keystone.server.flask.common [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 12:53:35.443247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.sql.core [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:53:35.443247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 12:53:35.443247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [parameters: {'id': 'd212ad5a92974c01a84fcbd5ea18ed30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 12:53:35.443247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81487) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d212ad5a92974c01a84fcbd5ea18ed30.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d212ad5a92974c01a84fcbd5ea18ed30. Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:53:35.451932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result.read() Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 12:53:35.453036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application yield resource Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise self.value Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application session.commit() Sep 07 12:53:35.454233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:53:35.455537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:53:35.456487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application result.read() Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:53:35.457596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [parameters: {'id': 'd212ad5a92974c01a84fcbd5ea18ed30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:35.458512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:35.459284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d212ad5a92974c01a84fcbd5ea18ed30. Sep 07 12:53:35.460277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:35.462468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 474/947] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Sep 7 12:53:35 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:35.468640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:35.584011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81646a9-d2fd-4691-ba11-cf78323f7a4e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.592456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:35.622652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.623919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.624199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.624468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.631718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.633164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d661c08c-ba20-462c-8711-a7d3fc209cef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:35.645470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:35.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:35.649756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:35.655036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 474/948] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:35.655286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:35.762951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86123-ed30-46e1-b2fd-44b6b78519b7 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:35.773522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:35.807403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:35.808053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.808328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.808591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.809290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:35.809587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:35.812476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c0c2c-8934-4d56-847a-ee8cf6797ab1 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:35.836678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 475/949] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:35.942477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526aa6-aa70-448e-a0e6-c34aa34a9ce9 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.942993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526aa6-aa70-448e-a0e6-c34aa34a9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.943098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526aa6-aa70-448e-a0e6-c34aa34a9ce9 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.944682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 475/950] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:35.950107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363d220-bf3e-4d21-a02f-ac56da6a0f7b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:35.950948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363d220-bf3e-4d21-a02f-ac56da6a0f7b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:35.951674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363d220-bf3e-4d21-a02f-ac56da6a0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:35.971963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2363d220-bf3e-4d21-a02f-ac56da6a0f7b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:35.973967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2363d220-bf3e-4d21-a02f-ac56da6a0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:36.056594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 476/951] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:36.122849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1da44-6ab5-4b54-b5be-26b2b0b6f04f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.123826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1da44-6ab5-4b54-b5be-26b2b0b6f04f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.124117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1da44-6ab5-4b54-b5be-26b2b0b6f04f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.125725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 476/952] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:36.131187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7273b0-ef51-4318-b41a-dbe49cf1176b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.131493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7273b0-ef51-4318-b41a-dbe49cf1176b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.131778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7273b0-ef51-4318-b41a-dbe49cf1176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.151910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-8b7273b0-ef51-4318-b41a-dbe49cf1176b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:36.153132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8b7273b0-ef51-4318-b41a-dbe49cf1176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:36.228329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 477/953] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:36.273596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695222b8-d7ee-4765-8f20-97e2712a8042 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.273912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695222b8-d7ee-4765-8f20-97e2712a8042 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.274147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695222b8-d7ee-4765-8f20-97e2712a8042 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.275774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 477/954] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:36.281059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.281342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.281608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.299995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:36.301167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:36.325286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.354479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695222b8-d7ee-4765-8f20-97e2712a8042 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.379494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 478/955] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:36.474790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695222b8-d7ee-4765-8f20-97e2712a8042 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.507871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.513795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.514431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.514700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.514966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] PATH_INFO: `/v3/services/compute` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.515567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.519199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:36.528677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:36.529941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:36.530808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 478/956] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:36.536388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.621351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.635377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96be53-9e5f-420c-b586-33b63d142840 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.646579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a6e7c-6d5c-4708-9269-155f08266cff None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.675335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037b257-0884-4fff-9366-883307aad63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.676114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b257-0884-4fff-9366-883307aad63b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.676398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b257-0884-4fff-9366-883307aad63b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.676674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037b257-0884-4fff-9366-883307aad63b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.688082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037b257-0884-4fff-9366-883307aad63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:36.688257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.688732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.689006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.689275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.689896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:36.690196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.691590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-d037b257-0884-4fff-9366-883307aad63b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:36.693053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:36.693951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:36.694799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 479/957] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:36.695532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037b257-0884-4fff-9366-883307aad63b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.704148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 479/958] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:36.705030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.719113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.806354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.815317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037b257-0884-4fff-9366-883307aad63b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.815686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5560-e415-48e5-8d1d-2b29f172d0ee None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.854334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.854959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:36.855217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.855525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.855653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:36.855824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.855923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:36.856124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:36.856380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.856780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:36.857106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:36.858830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.859181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:36.867836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:36.868818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:36.869764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:36.870485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 480/959] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:36.870485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.875577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 480/960] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:36.875577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:36.969763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:36.989804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7fd28-4870-4749-bcef-f95167e4bf8d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:36.992670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0af2-f454-4fb5-97a2-949d63c6beb8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.024860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.025488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.025770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.026038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.028209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.028840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.029117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.029920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.030898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] RBAC: Adding query filter params (type=compute) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.031203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.032622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.047511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 481/961] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.047511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.049710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.051195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:37.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:37.072869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:37.073779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:37.073779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:37.073779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:37.075379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 481/962] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:37.077622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.081294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.177879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793e06-3c19-44e8-84a7-5aa2ccbda7da None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.195795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90fb26-4d49-4013-9b61-094bccef0c40 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.222055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.223189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.223501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.223785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.224592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.225100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.226941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.239985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 482/963] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.240869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.240995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.241824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.242309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.242771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.243685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.244054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.245500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.247493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.266754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 482/964] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.267979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.353676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.374329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3f939-8763-4352-a2f9-4b39e074bab0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.407689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf90bb-fa45-446d-8dd8-67d66f107437 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.410475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.411329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.411937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.412451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.413263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.413738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.415280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.421649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 483/965] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.427418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.451308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.452223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.453041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.453327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.464434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.465895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:37.482224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:37.484023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:37.485035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 483/966] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:37.492397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.552734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eee0-036c-4698-b2d4-090eb307dda8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.565937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.590301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.591299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.592340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.592811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.593681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.595300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.623536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a3a01-a235-4fe8-ae03-94bfa9754c98 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.624262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 484/967] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:53:37.673897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.674741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.675092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.675423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.676206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:37.676513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.677976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.699873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 484/968] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:37.709040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:37.713377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:37.834519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebce-f67a-415e-a349-bdbd36a52e68 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:37.870514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:37.871122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:37.871399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:37.871698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:37.945026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:37.946552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704658e8-a9bc-462f-9806-52c8088e6ba2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:37.949513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.062567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 485/969] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:38.068143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.134792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bc07-859e-4100-b27f-fc804df5c527 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.135103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bc07-859e-4100-b27f-fc804df5c527 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.135342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bc07-859e-4100-b27f-fc804df5c527 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.136865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 486/970] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:38.143505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.143779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.144048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.168163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:38.170534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:38.189506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed10a3-940f-42cc-8d90-0fb7c7cf23dc None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.204979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.241952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.243354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.244076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.244549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.255152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 487/971] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:38.265311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.266768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:38.283569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:38.284546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:38.285642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:38.285642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:38.285642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:38.285642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 485/972] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:38.290406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.325957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.396862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5c30c-282a-438c-9f87-69ab666974a7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.431820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.432786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.433283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.433750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.434593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:38.435124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.437758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.449964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 488/973] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:38.456093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.559687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.577919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc82e2e-654e-44bf-a741-aa812eb87539 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.614474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.615113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.615396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.615697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.623658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.625308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:38.637799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:38.639356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:38.640955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 486/974] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:38.648613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.665967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.674121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2512a-c37d-4639-9178-09d50de7df2e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.675363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.713253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.713867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.714140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.714407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.715061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.716538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.719176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING keystone.server.flask.common [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 12:53:38.733452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.sql.core [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:53:38.733452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 12:53:38.733452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [parameters: {'user_id': '46af93d090fd4f20b3de99e8e06d5766', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 12:53:38.733452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81486) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application result.read() Sep 07 12:53:38.751543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:53:38.752563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application yield resource Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise self.value Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application session.commit() Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:53:38.753499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:53:38.754367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:53:38.755295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application result.read() Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:53:38.756201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [parameters: {'user_id': '46af93d090fd4f20b3de99e8e06d5766', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:38.757035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 12:53:38.759301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 12:53:38.761246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.763454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 489/975] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Sep 7 12:53:38 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:38.770362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.781743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c731ec-32ad-4d7b-962a-4b11b2ade4d8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.829619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.830452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.830870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.831717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.832340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:38.832650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.835089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.851501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 487/976] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:38.855309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.893709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28701d39-6b64-488c-a604-73fd08f87505 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:38.934579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:38.935395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:38.936254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:38.936530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:38.945420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:38.947110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:38.960172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:38.961147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:53:38.962070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:38.966176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 490/977] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:38.967510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:38.968725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.993069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:38.994708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0f841-3424-4308-a7a5-a701ec7a09a9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:39.041360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:39.041975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.042253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.042522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.043248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] RBAC: Adding query filter params (role.id=532210c582834e99a09783449276300b, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=0dab0ca4926a45c0a0476bf3599161ef) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:39.044580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:39.045560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1ab1-5083-43ac-b5d6-543665c63ba2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.052528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 488/978] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/role_assignments?user.id=0dab0ca4926a45c0a0476bf3599161ef&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=532210c582834e99a09783449276300b => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:39.106393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98984bb-5c16-4bda-8cbd-41b64ba1d5b5 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:39.149316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:39.150338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.150819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.151345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.152337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:39.152860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:39.154668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81db03-fbfe-4032-9d1d-15837766144e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.207634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 491/979] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Sep 7 12:53:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:39.318307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d002-5a59-4457-aedc-ff052551aea1 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.318851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d002-5a59-4457-aedc-ff052551aea1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.318851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d002-5a59-4457-aedc-ff052551aea1 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.320490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 489/980] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:39.326811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aa189-5f08-4aa8-a954-4604df8d5eab None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.327099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aa189-5f08-4aa8-a954-4604df8d5eab None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.327372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aa189-5f08-4aa8-a954-4604df8d5eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.347733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9a9aa189-5f08-4aa8-a954-4604df8d5eab None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:39.349313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9a9aa189-5f08-4aa8-a954-4604df8d5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:39.425739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 492/981] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:39.691549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d002-5a59-4457-aedc-ff052551aea1 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:39.796143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d002-5a59-4457-aedc-ff052551aea1 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:39.833815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:39.834419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:39.834691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:39.834955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:39.835644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:39.836983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a3d16-b86c-4ba0-b5d0-328b2c1a1457 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:39.855528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 490/982] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:39 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:40.039509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8108062-2f10-45fc-9cb2-55313cb6c768 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.039720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8108062-2f10-45fc-9cb2-55313cb6c768 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.040001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8108062-2f10-45fc-9cb2-55313cb6c768 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.041368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 493/983] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:40.047310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.047637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.047919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.055240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:40.070820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:40.072076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:40.149146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 491/984] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:40.425472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8108062-2f10-45fc-9cb2-55313cb6c768 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:40.429356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:40.538508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8108062-2f10-45fc-9cb2-55313cb6c768 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:40.574422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:40.575046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.575319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.575623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.576226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:40.577656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:40.586700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:40.587765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:40.588652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 494/985] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:40.596178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:40.697501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de41dd-bc92-4e89-a0a2-114de7f600b5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:40.726570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:40.734318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:40.734921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.735194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.735482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.736106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:40.736404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:40.737740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:40.742847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 492/986] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:40.749246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:40.821682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:40.865636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01391ebc-e930-476b-bf2c-e96f59a8bce8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:40.903992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:40.905320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:40.905592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:40.905861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:40.906475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:40.906768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:40.908486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:40.918164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 495/987] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:40.919388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.027593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cbbc1-a3f1-457c-b3d4-47e9cea4fe6e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.063765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.064500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.064724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.064992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.065695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=be666797f4c748e59585b8c12ea812fb, region_id=RegionOne) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:41.066002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.067341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d10db-4792-4256-ae4e-d97b6f80b6b9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.078125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 493/988] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Sep 7 12:53:40 2022] GET /identity/v3/endpoints?service_id=be666797f4c748e59585b8c12ea812fb&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:41.079555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.201926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d189ec-42a6-4472-9e20-bb41cfd8b171 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.231164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.237915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.238513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.238785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.239049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.239672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.241038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88fd3b-8798-425f-9a84-579f601c5757 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.255746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 496/989] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:53:41.300629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f2a0-83fc-43c2-8e89-004304c4d826 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.300836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f2a0-83fc-43c2-8e89-004304c4d826 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.301086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701f2a0-83fc-43c2-8e89-004304c4d826 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.302448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 494/990] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:41.308293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.308594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.308838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.328680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:41.329884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:41.402724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 497/991] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:41.669025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701f2a0-83fc-43c2-8e89-004304c4d826 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.731914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.778000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701f2a0-83fc-43c2-8e89-004304c4d826 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.814531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.815205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.815432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.815785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] PATH_INFO: `/v3/services/image` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.819509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.819509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:41.831774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:41.832800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:41.833645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:41.835783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 495/992] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:41.838628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:41.940621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0541e-f659-4281-a722-cdfd945b6aba None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:41.972144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:41.982814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:41.983444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:41.983751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:41.984021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:41.984661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] RBAC: Adding query filter params (name=image) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:41.984961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:41.986380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d955f5-ef19-4a4c-affb-fca9a2f3787c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:41.996798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 498/993] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:41.997786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.088513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce182f9-ffa7-4055-a451-baa0396dd846 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.088865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce182f9-ffa7-4055-a451-baa0396dd846 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.089060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce182f9-ffa7-4055-a451-baa0396dd846 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.090536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 499/994] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:42.095874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.096158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.096429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.103991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a98e0-ec0f-4435-9acc-9c379ad84d58 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.115182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:42.116747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:42.134347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.148663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.149271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.149550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.149824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.150456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] RBAC: Adding query filter params (type=image) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.150774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.152148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.157114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 496/995] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:42.201024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 500/996] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:42.476346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.587783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e0cec-2d71-4807-a277-715bab916145 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.622374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.623100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.623376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.623675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.624256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.625600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:42.634630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:42.635673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:42.636502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:42.639789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 497/997] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:42.642564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.746651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e131b-74e7-4383-8f30-e2c5a1373d0d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.766962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.782494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.783124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.783401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.783665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.784294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.784595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.785956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.795387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 501/998] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.796938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:42.853858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:42.908159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a116-7725-44a8-b8de-96db0b139af3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:42.942469 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:42.943069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:42.943339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:42.943634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:42.944284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:42.944579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:42.945916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:42.956364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 498/999] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:42.958085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.067334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cb0a-e3cc-4f40-8a3e-6a47f07a4285 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.102166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.102777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.103054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.103324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.104052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] RBAC: Adding query filter params (interface=public, service_id=fdc89edca6cd48228dc4a701dbd51387, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:43.104364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.105721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9c91-2974-458a-a6f0-c56b8706a194 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.117754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 502/1000] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:42 2022] GET /identity/v3/endpoints?service_id=fdc89edca6cd48228dc4a701dbd51387&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:43.119321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.228203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c9ee0-6e31-4b75-bf48-298816151565 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:43.242732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:43.264706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:43.265189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.265540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.265818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.266420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:43.267805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fe639-a06c-4983-8665-62fc44cd1b27 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:43.274395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 499/1001] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:43 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:53:43.514511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544e50-eb5a-4f09-8306-3c777b2fc25c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.514846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544e50-eb5a-4f09-8306-3c777b2fc25c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.515248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16544e50-eb5a-4f09-8306-3c777b2fc25c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.519354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 503/1002] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:43.523375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:43.526850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:43.526850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:43.548215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:43.549483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:43.624232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 500/1003] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:43.918684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16544e50-eb5a-4f09-8306-3c777b2fc25c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:43.983380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:44.047350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16544e50-eb5a-4f09-8306-3c777b2fc25c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.090050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:44.093201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.093478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.093745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.094390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:44.095843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:44.107407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:44.108492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 12:53:44.109422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:44.111822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 504/1004] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Sep 7 12:53:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:44.114619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:44.223407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae701c-b7fa-49bf-b5b0-4ad6fbb32d84 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.233528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:44.259153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:44.259780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.260052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.260317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.260937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:44.261234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:44.262570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:44.272346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 501/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:44.273737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:44.380679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3d62-ad63-4fdf-91b6-59b8ef0cc7b2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.396206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:44.418757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:44.419356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.419656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.420048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.420643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:44.420941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:44.422295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeec256-5457-41e2-abe0-7c88c46ffb9f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:44.431979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 505/1006] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Sep 7 12:53:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:44.433042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:44.483570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb485-d81a-4b3e-8181-a1c83d7f2f94 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.483882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb485-d81a-4b3e-8181-a1c83d7f2f94 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.484066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb485-d81a-4b3e-8181-a1c83d7f2f94 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.485562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 506/1007] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:44.490417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.490696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.490966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.509375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:44.510541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:44.551160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32712fe-2ca8-406e-8706-16f334683cca None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.586712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 507/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:53:44.590311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:44.590939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:44.591219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:44.591515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:44.592220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:44.593585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a61f4-83e9-462f-839c-65080d2e8a07 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:44.619501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 502/1009] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:53:44.853174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:44.954404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba192b99-d891-4554-a43c-0d66ae88fd78 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:44.962073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:45.000879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:45.001513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.001749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.002007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.002663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:45.004045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab0964-94f6-41b5-bf28-650ca0a10451 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:45.023494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 508/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:44 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:45.517544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaebff6-0a7e-4293-9136-e19bb130aa12 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.518068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaebff6-0a7e-4293-9136-e19bb130aa12 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.518250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaebff6-0a7e-4293-9136-e19bb130aa12 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.520057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 503/1011] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:45.528649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:45.528954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:45.529865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:45.550253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:45.551448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:45.627970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 509/1012] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:45 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:45.897974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaebff6-0a7e-4293-9136-e19bb130aa12 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:45.931586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.008692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaebff6-0a7e-4293-9136-e19bb130aa12 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.042012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.042628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.042901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.043165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.043780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.045922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:46.054651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:46.055650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 12:53:46.056503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:46.058045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 504/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:46.062079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.149255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.164228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c0c33-4822-4c9b-928e-ae1f6c58f97b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.199421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.200059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.200335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.200605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.202142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:46.202443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.203842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.209096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 510/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:46.214492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.318394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:46.325606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993e91-643d-4818-97b7-4893ff129ea8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.360454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.361064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.361338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.361608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.362241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:46.362541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.363921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b053a98-b1db-4af1-aea3-31ed2c491d75 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.374264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 505/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Sep 7 12:53:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:46.375827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:46.482179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454848df-0e5b-4a97-8d5d-6b17dec87ed1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:46.519584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:46.519584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.519584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.519584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.520021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:46.520021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f199d5f-2e8c-499a-bc99-23144b26ed41 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:46.549425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 511/1016] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:46.916165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400711a-266d-476f-980a-8c98d30827f5 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.916718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400711a-266d-476f-980a-8c98d30827f5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.916718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400711a-266d-476f-980a-8c98d30827f5 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.918078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 506/1017] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:46.924498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008fe-f537-44e4-bba2-371d1c8eb482 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:46.924842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008fe-f537-44e4-bba2-371d1c8eb482 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:46.925182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447008fe-f537-44e4-bba2-371d1c8eb482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:46.944063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-447008fe-f537-44e4-bba2-371d1c8eb482 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:46.945418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-447008fe-f537-44e4-bba2-371d1c8eb482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:46.947748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.028613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 512/1018] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:47.253667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94c54-b177-48ff-aa8e-5321b2318ca8 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.253957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94c54-b177-48ff-aa8e-5321b2318ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.254130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce94c54-b177-48ff-aa8e-5321b2318ca8 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.255647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 507/1019] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:47.260612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.261037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.261210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.280706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:47.281893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:47.305362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce94c54-b177-48ff-aa8e-5321b2318ca8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:47.353676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 513/1020] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:47.412582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce94c54-b177-48ff-aa8e-5321b2318ca8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.447796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.448427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.448704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.448973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.450089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.452496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.454240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 508/1021] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:47.459987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:47.531879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.577935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a30071-a497-4832-900b-2bafc9cac3e0 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.613202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.613806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.614086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.614358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.615015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.616467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.624282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:47.646259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 514/1022] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:53:47 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:47.656316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.740026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b284609-139c-4b11-9582-f1b260a75f4e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.777439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.777998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.778274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.778543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] PATH_INFO: `/v3/services/image` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.779300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.780779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:47.790490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:47.791780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:47.793014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 509/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Sep 7 12:53:47 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:47.798342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:47.908615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced6f68-3df1-44c5-a7ec-e6674008eb7a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:47.925879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:47.947003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:47.947649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:47.947926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:47.948195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:47.948830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:47.949131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:47.950488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:47.959506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 515/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:47.962717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:48.058256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:48.068786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f16e1-88e8-4a25-a27e-fb9fdb602aeb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:48.103400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:48.104036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.104315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.104582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.105200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] RBAC: Adding query filter params (type=image) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:48.105496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:48.106838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:48.112482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 510/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:48.118146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:48.221976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173a23-349d-4f4e-a60e-5c6e0afe5ee9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:48.265982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:48.266751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.266971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.267244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.267967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] RBAC: Adding query filter params (interface=public, service_id=b79a9018fcec4709b8c10e13b9d25c3f, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:48.268272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:48.269636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad6ff8-72c2-4cc2-8998-a72d85869923 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:48.275116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 516/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:53:48 2022] GET /identity/v3/endpoints?service_id=b79a9018fcec4709b8c10e13b9d25c3f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:48.280595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:48.383889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d80c-d830-4471-86b9-8607f619b624 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:48.418218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:48.418821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.419093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.419355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.420520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:48.421853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35185270-41c5-4b15-8193-2c1ab2a1d9e8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:48.435949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 511/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:53:48 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 12:53:48.868325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f6d2-903c-4e39-8b86-a969f32f6581 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.868637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f6d2-903c-4e39-8b86-a969f32f6581 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.868878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f6d2-903c-4e39-8b86-a969f32f6581 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.870381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 517/1028] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:48.876154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:48.876439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:48.876712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:48.895650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:48.896853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:48.913384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:48.967579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 512/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:49.237906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2f6d2-903c-4e39-8b86-a969f32f6581 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.286672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.345088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2f6d2-903c-4e39-8b86-a969f32f6581 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.379982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.380603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.380877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.381145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.391948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:49.396729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:49.397704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:49.398538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:49.399972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 518/1030] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:49.403724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.502672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a726-5f04-4ec2-97ad-135ac26cd1da None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.544047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.544696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.544974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.545236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.545891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:49.546185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:49.547555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:49.562149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 513/1031] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:49.563433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.667337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad19c33-585f-48d3-8cff-3f26cc0f9f5a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.669747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.704108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.704915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.705449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.705449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.715781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:49.717573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:49.732808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:49.733910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:49.734784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:49.734784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:49.734784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:49.735782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 519/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:49.739774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.756530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:49.851247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e1645-1c2a-489b-8715-7d16b9b02420 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:49.884743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:49.885342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.885615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.885881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.886510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:49.886808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:49.888167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a1ea-48ec-4d61-86c0-bee3934cd3bc None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:49.905527 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 514/1033] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:49.906850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:49.913874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789324-2255-4844-9e04-92b27547c593 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.914152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789324-2255-4844-9e04-92b27547c593 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.914420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de789324-2255-4844-9e04-92b27547c593 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.915893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 515/1034] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:49.925877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:49.926169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:49.926425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:49.950865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:49.952444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:50.021612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2616f6-a426-4bdf-a8ad-525d632ced68 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.030974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 516/1035] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:50.057349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.057976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.058249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.058526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.066922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.068400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:50.079498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:50.080418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:50.081957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 520/1036] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:50.090903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.091390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.193937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8606-6732-4a9b-8bbc-cdfa0c92f673 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.229428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.230071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.230348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.230663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.231381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:50.231703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.233778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.256924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 517/1037] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:50.258472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.278436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.315265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.370904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e300cd0-5ab3-46a4-a04a-47952debd4fc None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.381604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.408011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.408618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.408894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.409167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.425850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63204c8-fb31-41aa-8a5b-e29c888fe9da None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.460674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.461302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.461584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.461854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.462955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.464420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.466001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 518/1038] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:50.472471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.483375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.484911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.502305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.593717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070beb1b-0261-46d7-bd88-33a971589191 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.605033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 521/1039] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:50.606081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.630863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.642027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.642919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.643203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.643509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.644661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.646694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd279-32f1-42a9-9f90-afa381c71f80 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.687354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 519/1040] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:53:50 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:53:50.687354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcf101-d811-4226-8260-74d1bf155a78 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.687354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcf101-d811-4226-8260-74d1bf155a78 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.687354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcf101-d811-4226-8260-74d1bf155a78 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.687354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 520/1041] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:50.689139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.689423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.689693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.708278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:50.709505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:50.735009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f118-26fb-49d8-a941-72737f0c34f4 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.759958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.782446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.783244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.783648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.784016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.787497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 521/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:50.797862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.799733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:50.817365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:50.818698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:50.819971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:50.819971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:50.819971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:50.825864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 522/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:50.827405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:50.936493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b855-b6a4-4da4-afce-713705f2dd59 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:50.955936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:50.981397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:50.982540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:50.982840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:50.983118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:50.983810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:50.984106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:50.986429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.003544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 522/1044] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:51.006632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.072948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.122415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df6dd-6039-400b-9af8-c282bd082237 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.159005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.159996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.160288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.160557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.169171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.170672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.183361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb8339-d455-4e50-835e-1a0bd915fb8b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:51.184261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:51.185121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:51.186572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 523/1045] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:51.192505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.222641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.223271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.223575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.223843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] PATH_INFO: `/v3/services/image` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.224424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.224656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.225768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:51.235048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:51.236302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:51.237239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 523/1046] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:51.242001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.286458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.318157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c209-862b-4420-a3c1-4094e62291d3 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.348808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e4106-6411-439f-bca7-35790f4412ef None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.362229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.363235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.364089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.364853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.365769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.366373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.368292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.383894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 524/1047] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:51.385291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.385951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.386285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.386612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.387294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.387685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.389563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.389919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.394946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 524/1048] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:51.400388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.486757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.500065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5b69-afbf-4732-986b-5bbc00882dc4 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.520148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffc8e7-02d6-4d73-b73a-797ae639dba3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.521929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:51.543509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.544111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.544454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.544773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.545521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] RBAC: Adding query filter params (role.id=532210c582834e99a09783449276300b, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.545820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.547243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.555505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 525/1049] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=532210c582834e99a09783449276300b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:51.567392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.568153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.568501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.568835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.569561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] RBAC: Adding query filter params (type=image) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:51.569934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.571405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0a34e-3777-424d-b56b-9e87e4821b95 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.578273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 525/1050] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:51.584345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:51.703249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8287-090e-4874-8f4d-402f265081b9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:51.742969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:51.743574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:51.743854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:51.744121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:51.744782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:51.746319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad2f3a-cd9a-4f6a-b2a3-896575952723 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:51.768244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 526/1051] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:53:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:53:53.222619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6f75-3af7-4db8-b420-9d2272eefcf3 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.233488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6f75-3af7-4db8-b420-9d2272eefcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.233488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a6f75-3af7-4db8-b420-9d2272eefcf3 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.233488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 526/1052] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:53.233731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.233731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.233731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.253211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:53.254396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:53.256484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.333983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 527/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:53.611287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a6f75-3af7-4db8-b420-9d2272eefcf3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.720037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a6f75-3af7-4db8-b420-9d2272eefcf3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.753234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.753855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.754126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.754388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.765624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:53.770386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:53.771457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:53.772639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:53.775788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 527/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:53.777710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.896320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367f4d-88bd-4070-addd-fc25d7ac9a48 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:53.930839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:53.931438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.931737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.932002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.932647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:53.932942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:53.934292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4c648-b055-4ef0-b06c-ba1b6bbc7e97 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:53.936241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:53.949281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 528/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:53.951672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:53.973810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31778-0772-47a3-a0e7-f67f845ad9a0 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.974116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31778-0772-47a3-a0e7-f67f845ad9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.974359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e31778-0772-47a3-a0e7-f67f845ad9a0 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.976461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 529/1056] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:53.979390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783b4fe-e3a6-4357-98ea-26973f283e7c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.979711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783b4fe-e3a6-4357-98ea-26973f283e7c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.979986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783b4fe-e3a6-4357-98ea-26973f283e7c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.981222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 530/1057] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:53:53.982317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fee8c-f76e-4189-a5f8-c05ba20025e7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:53.982609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fee8c-f76e-4189-a5f8-c05ba20025e7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:53.982885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fee8c-f76e-4189-a5f8-c05ba20025e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:53.983015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.001103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0b1fee8c-f76e-4189-a5f8-c05ba20025e7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:54.002397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0b1fee8c-f76e-4189-a5f8-c05ba20025e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:54.060821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf4e5-14c6-4895-9344-b8baf74c24aa None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.072060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 531/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:54.073431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.073722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.073992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.094626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:54.096034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:54.096913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.097568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.097848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.098119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] PATH_INFO: `/v3/users/64ab1163d7b743e38cabc17c48bb41d5` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.112820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] RBAC: Authorizing `identity:get_user(user_id=64ab1163d7b743e38cabc17c48bb41d5)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.114434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.116353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 528/1059] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:53 2022] GET /identity/v3/users/64ab1163d7b743e38cabc17c48bb41d5 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.121811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.171508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 532/1060] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:54.214355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.230803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59544-65e0-4da5-8daf-d839ff7d7042 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.266762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.267362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.267660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.267926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.338337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.339219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.339709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.399133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.429881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.446704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5536c7-d214-4bac-b955-65d5d0db2bf3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.449165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 529/1061] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 12:53:54.450067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.480895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.481520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.481796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.482825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.493224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:54.498816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:54.499912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 533/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:54.500775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.555431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebce54-f09c-47a6-9b9d-1af33302cd20 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.590336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.590863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.591141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.591481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.600414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3728e-aaef-40cd-b5f5-cf01538a4a0c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.617028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.635565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.636194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.636473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.636746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.637856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.639318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.640970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 534/1063] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.641835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.645174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.662718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.664201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.743521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26444233-2970-454d-b48f-05a5621e93b2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.765564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 530/1064] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:53:54.766235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.778580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.779865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.780153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.780426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.781158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:54.781570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.782954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.792197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 535/1065] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.793329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.845595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.866366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:54.885312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1c2ba-b7d4-47c4-9cd5-1a5ea4970886 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.905452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15f41d-285d-4b1d-967a-a8468de0f340 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:54.929392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.929998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.930274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.930546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.931258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=803e0da3887d46efb66567653b1cdc78, user.id=64ab1163d7b743e38cabc17c48bb41d5) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:54.931592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.932997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.944971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 531/1066] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/role_assignments?user.id=64ab1163d7b743e38cabc17c48bb41d5&scope.project.id=803e0da3887d46efb66567653b1cdc78&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:54.944971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:54.945273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:54.945552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:54.945835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:54.946101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:54.960656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:54.962158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:54.980670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:54.981731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:54.983907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:54.983907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:54.983907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:54.983907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 536/1067] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:54.988663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.072396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cc678-adbb-4c2d-ac92-c47fcec4a6ec None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.100054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.104052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d743-6f3a-4d25-a672-a2c9e6811f64 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.121187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.122018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.122300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.123133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.139405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.141034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.148504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.149191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.149547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.149888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.150018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.150703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:55.150941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.152567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:55.158739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:55.159742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:55.160631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:55.160631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:55.160631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:55.164724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 532/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:55.165450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.166891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 537/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:55.286538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f438e2-7cb8-4083-829e-af111e3dc503 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.325299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.326464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.326936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.327403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.328135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:55.328440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.329847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.344008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 533/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.349864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.464847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6324-6ed5-498e-aded-10fa7fa6b325 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.502226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.502867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.503152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.503422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.510991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.512475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:55.526642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:55.527833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:55.529638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:55.530483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 538/1071] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:55.533306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.592452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.633833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24a279-139f-4342-9913-65fdf920a4c8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.668537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.669143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.669457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.669900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.670676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:55.670982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.672430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.691070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 534/1072] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:55.696817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.716845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:55.796812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ebca-102a-4957-8b72-44ba2bfc19ea None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.831707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:55.832343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:55.832620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:55.832894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:55.845376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:55.846870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:55.862460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:55.863745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:55.864789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:55.864789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:55.864789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:55.864789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 539/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:55.869310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:55.968604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b0b25-ea6c-47f7-b33c-986696cb46a4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:55.985629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.002539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.003135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.003408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.003738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.004362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:56.004733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.006121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.017631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 535/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:56.023230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.093686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.125086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82e7-e939-48a1-ac5a-8e267d85fc60 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.158774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.159397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.159703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.159973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.166602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.168082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:53:56.179577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:56.180586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:56.181991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 540/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:56.187047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.288292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e446-bfc9-4b2a-84d3-4148e025eb78 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.322074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.322667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.322943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.323209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.323915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:56.324219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.325646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd6df3-3d6e-4566-98bd-b0932407f717 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.338373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 536/1076] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:56.344536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:56.444707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db601-09e6-4e90-a769-69e5f0b7511a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:56.472585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:56.478403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:56.479045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:56.479319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:56.479625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/532210c582834e99a09783449276300b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:56.481706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=565774033b5d4aaab833757169efb547, role_id=532210c582834e99a09783449276300b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:56.483168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2804f-174a-4d38-8846-3cb07d2a1307 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:56.495218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 541/1077] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:56 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/565774033b5d4aaab833757169efb547/roles/532210c582834e99a09783449276300b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:57.132774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0af5-3542-4158-b6f7-ffc114005686 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.133059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0af5-3542-4158-b6f7-ffc114005686 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.133333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0af5-3542-4158-b6f7-ffc114005686 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.134675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 537/1078] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:57.140116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.140471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.140816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.160137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:57.161317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:57.228280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 542/1079] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:57.502608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b0af5-3542-4158-b6f7-ffc114005686 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.550707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.613153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b0af5-3542-4158-b6f7-ffc114005686 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.646759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.647385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.647691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.647960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.658104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:57.662929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:57.664156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:53:57.665130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 538/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:53:57.670608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.768718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b11d1e-b54e-4e87-88d1-eea3f97cc51c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.788915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.803746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.804350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.804625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.804893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.805545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:57.805842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:57.807194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:57.815486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 543/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:57.821400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:57.917177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:57.922138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fb255-d893-4c34-8048-69646f933d3a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:57.955103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:57.955742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:57.956018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:57.956286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] PATH_INFO: `/v3/users/64ab1163d7b743e38cabc17c48bb41d5` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:57.957393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] RBAC: Authorizing `identity:get_user(user_id=64ab1163d7b743e38cabc17c48bb41d5)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:57.958788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:57.960375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 539/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/users/64ab1163d7b743e38cabc17c48bb41d5 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:57.966063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.072408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dd350-ae03-4b07-8cfe-e68f2dcad583 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.105595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.106212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.106488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.106756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.108487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.109906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d564f-d25b-4f4d-b111-12155b114648 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.111546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 544/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:53:57 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:58.117577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:58.216395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40c3f5-a6cb-4f90-a8b2-c401fd3c18a8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:58.250896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:58.251590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.251873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.252146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78/users/64ab1163d7b743e38cabc17c48bb41d5/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.254050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] RBAC: Authorizing `identity:create_grant(project_id=803e0da3887d46efb66567653b1cdc78, user_id=64ab1163d7b743e38cabc17c48bb41d5, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:58.255490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1b5e4-e961-4960-8763-ef9844983f73 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:58.268877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 540/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:53:58 2022] PUT /identity/v3/projects/803e0da3887d46efb66567653b1cdc78/users/64ab1163d7b743e38cabc17c48bb41d5/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:53:58.674756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233884-a717-4eae-983a-f8d8e1c474b3 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.675276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233884-a717-4eae-983a-f8d8e1c474b3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.675276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233884-a717-4eae-983a-f8d8e1c474b3 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.676683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 545/1085] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:53:58.682039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:58.682432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:58.682583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:58.700761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:53:58.701935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:53:58.722405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:58.775756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 541/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:53:59.044552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233884-a717-4eae-983a-f8d8e1c474b3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.096534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.152189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233884-a717-4eae-983a-f8d8e1c474b3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.186233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.187120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.187396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.187693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.197465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:53:59.202760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:59.203817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:59.204641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 546/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:59.209936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.305840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8f00-f040-406e-bd50-0572231f91ab None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.339299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.339912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.340186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.340456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.341098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:59.341589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.342968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.350617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 542/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:53:59.356473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.455087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f333a-d40e-4fc3-a5b9-83e29b7ea48d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.465669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.489335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.489954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.490225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.490493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.500967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.502406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:53:59.518164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:59.519140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:53:59.520081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:53:59.520081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:53:59.520081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:59.520081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 547/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:59.526815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.546242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.627820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bd7a5-8e8a-42a7-9afd-d280559d8578 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.660914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.661509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.661785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.662054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.662685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:59.662985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.664356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.676433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 543/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:53:59.682127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.779843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959604d-3bd4-4e48-a328-f87c9c8f2790 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.814119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.814747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.815024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.815299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.823516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.824944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:53:59.836108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:53:59.837214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:53:59.838334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 548/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:53:59.843237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:53:59.920802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:53:59.942992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5e392-df72-4f9b-8b06-a81989300aba None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:53:59.975957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:53:59.976550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:53:59.976820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:53:59.977084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:53:59.977791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:53:59.978088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:53:59.979504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:53:59.997086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 544/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Sep 7 12:53:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:00.003676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.028455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.104876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b49491-07dc-4c31-b32f-294bd7bb0b08 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.137493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.138114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.138387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.138654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.203994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.205355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7312e5-dc7e-40fe-900f-04cdcf30ad77 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.228377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.304923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 549/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:00.311160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.415723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a578353-17e1-409e-85ae-f061b202f65d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.434310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03decd-ba06-4cfc-92a9-2c77a007fc45 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.434598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03decd-ba06-4cfc-92a9-2c77a007fc45 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.434871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03decd-ba06-4cfc-92a9-2c77a007fc45 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.436237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 550/1094] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:00.441564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.441838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.442106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.454107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.454673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.454955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.455235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.457953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.460510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:00.461704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:00.466112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.468300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:00.484983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:00.486185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:54:00.487206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:00.487206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:54:00.487206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:00.487206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 545/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:00.491879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.534935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 551/1096] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:54:00.596317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aba042-f0a7-407d-bc5d-21bb028cae4f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.628687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.629279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.629555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.629821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.630448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:00.630746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.632121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.644251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 546/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:00.649917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.703509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.750922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eeccc-9130-4c02-84a6-3405a16eccaf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.786101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee601-2c1f-4128-b780-54920464357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.786723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee601-2c1f-4128-b780-54920464357c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.786999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee601-2c1f-4128-b780-54920464357c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.787265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee601-2c1f-4128-b780-54920464357c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.793818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee601-2c1f-4128-b780-54920464357c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.795655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee601-2c1f-4128-b780-54920464357c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.805908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-201ee601-2c1f-4128-b780-54920464357c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:54:00.806747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:00.807687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:54:00.808713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 552/1098] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:00.814753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee601-2c1f-4128-b780-54920464357c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.856700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.908526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69d10-e9ce-4d32-a3d3-2d2133d3fae4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.917617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee601-2c1f-4128-b780-54920464357c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:00.930530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:00.944875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.945498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.945774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.946048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.952869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:00.953461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:00.953734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:00.954003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:00.954686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:00.954986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:00.956517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:00.956963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:00.961811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:00.962912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:00.964618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 547/1099] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:54:00.974591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 553/1100] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:00.974750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:00.975623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.069689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6df01-3edd-4ede-bd96-bb8f0fe47552 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.075721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227af21-4b58-438f-937c-c7ea90990814 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.078679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.103700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.104291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.104565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.104830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.105476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:01.105773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.107819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.110153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.110860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.111421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.111421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.112199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] RBAC: Adding query filter params (role.id=532210c582834e99a09783449276300b, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=565774033b5d4aaab833757169efb547) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:01.112502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.113903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.116408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 548/1101] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:01.122281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.135514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 554/1102] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:00 2022] GET /identity/v3/role_assignments?user.id=565774033b5d4aaab833757169efb547&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=532210c582834e99a09783449276300b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:01.237941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459cb9-afcd-4471-a2f2-b1d42b431c89 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.274502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.275145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.275421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.275721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] PATH_INFO: `/v3/users/64ab1163d7b743e38cabc17c48bb41d5` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.276866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] RBAC: Authorizing `identity:get_user(user_id=64ab1163d7b743e38cabc17c48bb41d5)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.278302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.280709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 549/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/users/64ab1163d7b743e38cabc17c48bb41d5 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:01.286632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.326863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.392793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aaed5-dcb7-4678-b92b-5877e3cee701 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.427852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.428462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.428736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.429012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.499820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.501293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.539115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.609068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 555/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:01.614924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.657621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.721449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd741881-2476-4fa9-b7e6-6a4836258461 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.756940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.757596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.757872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.758141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.759249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.760705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb314ee-7717-4844-9c95-ac46076e701c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.762512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 550/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:01.768991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:01.875703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6380b-f713-4425-b88a-33eabdf50c5b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:01.909884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:01.910484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:01.910759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:01.911031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:01.911783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=803e0da3887d46efb66567653b1cdc78, user.id=64ab1163d7b743e38cabc17c48bb41d5) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:01.912093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:01.913510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a6e8-d6a8-4a2a-9d18-0ef1237827e0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:01.916332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:01.920644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 556/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:01 2022] GET /identity/v3/role_assignments?user.id=64ab1163d7b743e38cabc17c48bb41d5&scope.project.id=803e0da3887d46efb66567653b1cdc78&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:04.118322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121866a9-ab5c-44c5-8b30-1eacb6ea02da None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.118871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121866a9-ab5c-44c5-8b30-1eacb6ea02da None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.118871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121866a9-ab5c-44c5-8b30-1eacb6ea02da None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.120283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 551/1107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:04.126690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.127116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.127248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.156731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:04.157924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:04.224723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 557/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:04.502222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121866a9-ab5c-44c5-8b30-1eacb6ea02da None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.600985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121866a9-ab5c-44c5-8b30-1eacb6ea02da None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.608881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.634726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.635336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.635639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.635905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.636991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.638486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2d38f-4f85-45b4-85c2-eb1badd47653 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.640072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 552/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:04.645970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:04.742013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139e371-f20f-488e-8a03-17884edd8a9d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:04.770034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:04.776193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:04.776787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:04.777059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:04.777324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:04.777996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:04.780066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c53fa6-6252-442f-9bf5-c941a77ba735 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:04.801893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 558/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:04 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:07.046752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe53c-1583-4ede-9224-ea09e5970c4f None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:07.047278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe53c-1583-4ede-9224-ea09e5970c4f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:07.047278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe53c-1583-4ede-9224-ea09e5970c4f None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:07.048733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 553/1111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:07.054353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:07.054765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:07.054903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:07.073529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:07.074710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:07.140980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 559/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:07.423264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe53c-1583-4ede-9224-ea09e5970c4f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:07.525627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe53c-1583-4ede-9224-ea09e5970c4f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:07.561031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:07.561914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:07.562190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:07.562460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] PATH_INFO: `/v3/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:07.563943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] RBAC: Authorizing `identity:get_role(role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:07.565296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:07.566620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 554/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:07 2022] GET /identity/v3/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:07.572391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:07.690940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec949f-a471-4405-9ac5-ca6b3266a00f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:07.707104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:07.725533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:07.726156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:07.726432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:07.726705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] PATH_INFO: `/v3/users/e2ef6662b0204fb281e266ade96171a7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:07.740235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef6662b0204fb281e266ade96171a7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:07.741803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:07.743409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 560/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:07 2022] GET /identity/v3/users/e2ef6662b0204fb281e266ade96171a7 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:07.749725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:07.792792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:07.849778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdef28-d360-4d44-ac59-06d81767640e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:07.883174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:07.883796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:07.884066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:07.884332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:07.959551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:07.960899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:08.001181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:08.056520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 555/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:08.063531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:08.160672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301146-640d-4625-8149-c83ec9c8c4b6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:08.194548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:08.195146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:08.195420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:08.195758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:08.196855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:08.198312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d83ed-9ada-44ec-9c7a-0918c93c96d8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:08.199958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 561/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:08 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:08.205988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:08.302674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80515383-c4ef-45b9-9854-ec7cc9c77a7e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:08.336286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:08.336876 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:08.337149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:08.337415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:08.338127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=803e0da3887d46efb66567653b1cdc78, user.id=e2ef6662b0204fb281e266ade96171a7) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:08.338432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:08.339863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2eb74-de95-450a-bdab-efacdc8bc122 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:08.345604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 556/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:08 2022] GET /identity/v3/role_assignments?user.id=e2ef6662b0204fb281e266ade96171a7&scope.project.id=803e0da3887d46efb66567653b1cdc78&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:10.449114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e2ab-b6f8-4052-b641-67e82839b510 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.449672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e2ab-b6f8-4052-b641-67e82839b510 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.449672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e2ab-b6f8-4052-b641-67e82839b510 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.451513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 562/1118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:54:10.456780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.457271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.457377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.470587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.476186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:10.477360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:10.546624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 557/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:10.815945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e2ab-b6f8-4052-b641-67e82839b510 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:10.860291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:10.916903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504e2ab-b6f8-4052-b641-67e82839b510 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:10.950956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:10.951595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:10.951874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:10.952143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] PATH_INFO: `/v3/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:10.953521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] RBAC: Authorizing `identity:get_role(role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:10.954944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:10.956300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 563/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:10.962118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:11.062566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb13bc-0025-4448-92c2-71fdcbdef8b4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.095045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.095613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.095890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.096161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] PATH_INFO: `/v3/users/e2ef6662b0204fb281e266ade96171a7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.097267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef6662b0204fb281e266ade96171a7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.098675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.100278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 558/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:10 2022] GET /identity/v3/users/e2ef6662b0204fb281e266ade96171a7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:11.106040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:11.204646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24ab4-5af6-4657-ad16-d33b5e3413ee None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.214564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:11.238377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.238992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.239270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.239572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.240733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.242187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63706cf0-c43c-44f7-86b4-fa9dd760c423 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.243846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 564/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:11 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:11.250478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:11.254186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:11.347984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae927c69-378b-4106-91e1-400ee5456e11 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:11.382243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:11.382886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:11.383162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:11.383429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78/users/e2ef6662b0204fb281e266ade96171a7/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:11.385649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=803e0da3887d46efb66567653b1cdc78, user_id=e2ef6662b0204fb281e266ade96171a7, role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:11.387059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b409-7728-48b3-9986-55a220b11ef3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:11.399888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 559/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:11 2022] PUT /identity/v3/projects/803e0da3887d46efb66567653b1cdc78/users/e2ef6662b0204fb281e266ade96171a7/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:13.563301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813eaf1-7993-444b-9099-ed299c0f856c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.563910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813eaf1-7993-444b-9099-ed299c0f856c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.563910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813eaf1-7993-444b-9099-ed299c0f856c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:13.565220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 565/1124] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:13.570511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:13.570912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:13.571046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:13.588728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:13.589901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:13.653990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:13.663585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:13.934850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813eaf1-7993-444b-9099-ed299c0f856c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.039541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813eaf1-7993-444b-9099-ed299c0f856c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.071719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.072328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.072601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.072865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] PATH_INFO: `/v3/roles/1fd31f082e4844e68a0d180982b50bd7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.074222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] RBAC: Authorizing `identity:get_role(role_id=1fd31f082e4844e68a0d180982b50bd7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.076226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.077528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 566/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:13 2022] GET /identity/v3/roles/1fd31f082e4844e68a0d180982b50bd7 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:14.083325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.182539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48921db-f7bc-4eb0-8492-8052991ed36d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.216644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.217205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.217486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.217759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] PATH_INFO: `/v3/users/e2ef6662b0204fb281e266ade96171a7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.218886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] RBAC: Authorizing `identity:get_user(user_id=e2ef6662b0204fb281e266ade96171a7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.220334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.221919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 561/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/users/e2ef6662b0204fb281e266ade96171a7 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:14.227802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.273309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.334849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8de777-3083-4cba-957b-22b3256b4798 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.368348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.368938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.369215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.369484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.434931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.436798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.479336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.532564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 567/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:14.538377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.597647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:14.635562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa11938-bde1-45fd-899a-ad41933097cf None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.668214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.668825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.669697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.670101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] PATH_INFO: `/v3/projects/803e0da3887d46efb66567653b1cdc78` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.671205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] RBAC: Authorizing `identity:get_project(project_id=803e0da3887d46efb66567653b1cdc78)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.672634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b183f4c-1e6c-4356-875a-0c2eb37d4b54 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.674249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 562/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/projects/803e0da3887d46efb66567653b1cdc78 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:14.680671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:14.777402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a38c1-ee4e-45ef-903c-43da11f94ef6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:14.812781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:14.813383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:14.813662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:14.813942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:14.814663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] RBAC: Adding query filter params (role.id=1fd31f082e4844e68a0d180982b50bd7, scope.project.id=803e0da3887d46efb66567653b1cdc78, user.id=e2ef6662b0204fb281e266ade96171a7) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:14.814971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:14.816437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e48597-a5f4-4cd4-b676-b12928fe69f7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:14.822189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 568/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:14 2022] GET /identity/v3/role_assignments?user.id=e2ef6662b0204fb281e266ade96171a7&scope.project.id=803e0da3887d46efb66567653b1cdc78&role.id=1fd31f082e4844e68a0d180982b50bd7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:16.975881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3c3c-6df7-49cb-93a4-966af132363e None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.976437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3c3c-6df7-49cb-93a4-966af132363e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.976437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de3c3c-6df7-49cb-93a4-966af132363e None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:16.977757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 563/1131] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:16.983554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:16.983965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:16.984105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.002951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:17.004171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:17.006875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.070409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 569/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:17.338585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de3c3c-6df7-49cb-93a4-966af132363e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.456582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de3c3c-6df7-49cb-93a4-966af132363e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.485105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.491118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.491757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.492032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.492298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.493385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.494784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17aa6-6e51-496f-aab6-7a7b2ce3af73 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.496365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 564/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:17.502440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:17.598590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a9cb0-ded3-423c-adfc-f38d803a2ded None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:17.630898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:17.631506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:17.631783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:17.632049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:17.632692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:17.634094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cc5b7-a4ed-4e85-93e6-981f43330322 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:17.644978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:17.661222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 570/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:54:17 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:19.908776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b832a-247a-4366-bdb2-6e16b36cf175 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.909299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b832a-247a-4366-bdb2-6e16b36cf175 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.909299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b832a-247a-4366-bdb2-6e16b36cf175 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.910632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 565/1135] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:19.915951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:19.916380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:19.916533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:19.935522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:19.936984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:20.012754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 571/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:20.282027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b832a-247a-4366-bdb2-6e16b36cf175 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.410213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b832a-247a-4366-bdb2-6e16b36cf175 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.443813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.444424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.444702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.444971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.446068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.447499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd05f5-b3b7-43b7-b298-e0ea13a6affa None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.449060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 566/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:20.454953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:20.554817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89158ae4-b9bd-4045-aefe-374ce2bf56c6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:20.579008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:20.591920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:20.592530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:20.592810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:20.593083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:20.593729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:20.595161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb288c11-2860-47f9-ab68-2736063cedf0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:20.616263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:20 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:22.838345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6d60-e444-44b5-85af-23cfd0ced885 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.838895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6d60-e444-44b5-85af-23cfd0ced885 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.838895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6d60-e444-44b5-85af-23cfd0ced885 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.840168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 567/1139] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:22.845649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:22.846045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:22.846203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:22.864588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:22.865782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:22.933427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 573/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:23.204960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6d60-e444-44b5-85af-23cfd0ced885 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.270860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.306419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6d60-e444-44b5-85af-23cfd0ced885 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.339962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.341050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.341333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.341593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.351596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:23.356887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:23.358958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:23.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 568/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:23.364199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.461520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89730-15d0-4876-8113-3d13fd89e198 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.470877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.495903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.496494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.496767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.497214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.497905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:23.498202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.499583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.507308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 574/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:23.513701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.613132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eebdd-010b-4861-8eea-1adf5ca164a9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.638144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.646993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.647641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.647915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.648181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] PATH_INFO: `/v3/users/2380125142c84f558a9745967fede143` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.661464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] RBAC: Authorizing `identity:get_user(user_id=2380125142c84f558a9745967fede143)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.662874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.664508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 569/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/users/2380125142c84f558a9745967fede143 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:23.670874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:23.770329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a69d2e-95b8-4224-9685-e93fe347decf None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:23.804121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:23.804717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:23.804998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:23.805269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:23.844001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:23.872320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:23.873761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:23.968436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 575/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:23.974463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.072175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31b8fa-226e-4149-8053-da308320d662 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.105564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.106347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.106561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.106874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] PATH_INFO: `/v3/projects/8ee1132186d24c8b95c7b0c2c618b299` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.108290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee1132186d24c8b95c7b0c2c618b299)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.109710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85502baf-8c75-4318-8f75-15a994f5d373 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.111353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 570/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:23 2022] GET /identity/v3/projects/8ee1132186d24c8b95c7b0c2c618b299 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:24.117465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:24.185126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:24.216422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199971e3-0df1-42bf-8dd0-cd3d3f4f32e1 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:24.248284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:24.248866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:24.249136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:24.249400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:24.250099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=8ee1132186d24c8b95c7b0c2c618b299, user.id=2380125142c84f558a9745967fede143) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:24.250399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:24.251826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ef38-0834-4bdb-a44d-bb8dee1ed0c8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:24.256917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 576/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:24 2022] GET /identity/v3/role_assignments?user.id=2380125142c84f558a9745967fede143&scope.project.id=8ee1132186d24c8b95c7b0c2c618b299&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:26.377546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e042-f371-493d-8ddb-b214ca620feb None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.378098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e042-f371-493d-8ddb-b214ca620feb None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.378098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486e042-f371-493d-8ddb-b214ca620feb None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.379421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 571/1147] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:26.384628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.385016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.385173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.402876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:26.404694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:26.469753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 577/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:26.745429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e042-f371-493d-8ddb-b214ca620feb None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.798638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:26.848368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486e042-f371-493d-8ddb-b214ca620feb None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:26.882312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:26.882931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:26.883208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:26.883498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:26.894419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:26.899253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:26.900402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:26.901254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 572/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:26.908207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:26.970460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.007058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bccbcc-13b5-473a-b65f-3b8abd02966c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.041040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.041636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.041917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.042187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.042837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:27.043137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.044829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.052678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 578/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.058566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.157295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373807dc-49ac-47a4-b5de-41ecafc3cc95 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.170154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.191415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.192061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.192336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.192602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] PATH_INFO: `/v3/users/2380125142c84f558a9745967fede143` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.193698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] RBAC: Authorizing `identity:get_user(user_id=2380125142c84f558a9745967fede143)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.195104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.196701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 573/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/users/2380125142c84f558a9745967fede143 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.203126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.299362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc360f6-2a46-4653-9134-9bce91dc0057 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.324056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:27.333632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.334247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.334521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.334788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] PATH_INFO: `/v3/projects/8ee1132186d24c8b95c7b0c2c618b299` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.335911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] RBAC: Authorizing `identity:get_project(project_id=8ee1132186d24c8b95c7b0c2c618b299)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.337329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67464cdb-a5be-4962-9fdb-0047f241190b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.338938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 579/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:27 2022] GET /identity/v3/projects/8ee1132186d24c8b95c7b0c2c618b299 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:27.344966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:27.445898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4365a0-cc80-44ce-8e14-73c3be5e4793 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:27.479161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:27.479822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:27.480094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:27.480356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] PATH_INFO: `/v3/projects/8ee1132186d24c8b95c7b0c2c618b299/users/2380125142c84f558a9745967fede143/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:27.482812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1132186d24c8b95c7b0c2c618b299, user_id=2380125142c84f558a9745967fede143, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:27.484239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad67e-8e8a-4cd7-9278-5c26f8a4efe4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:27.497585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 574/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:27 2022] PUT /identity/v3/projects/8ee1132186d24c8b95c7b0c2c618b299/users/2380125142c84f558a9745967fede143/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:29.652230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ec76-0baa-485e-b68a-d270e4c6a11f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.652777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ec76-0baa-485e-b68a-d270e4c6a11f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.652777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8ec76-0baa-485e-b68a-d270e4c6a11f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.655725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 580/1154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:29.660984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:29.661419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:29.661522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:29.680044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:29.681214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:29.714784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:29.748444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 575/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:30.026271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ec76-0baa-485e-b68a-d270e4c6a11f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.125539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8ec76-0baa-485e-b68a-d270e4c6a11f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.158084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.158684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.158957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.159223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.169125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:30.173957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:30.175076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:54:30.175963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 581/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:30.181078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.279151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b7274-9a58-49a3-a692-3de600706fbd None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.312107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.312693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.312967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.313256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.313899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:30.314193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.315552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.323260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 576/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:30.330112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.383232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.426500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973592c1-1896-4baf-8fdc-f90444614d32 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.459640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.460245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.460515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.460780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] PATH_INFO: `/v3/users/2380125142c84f558a9745967fede143` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.461864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] RBAC: Authorizing `identity:get_user(user_id=2380125142c84f558a9745967fede143)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.463287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.464865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 582/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/users/2380125142c84f558a9745967fede143 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:30.470939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.502281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.570331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a6db-7385-41e0-b293-2a8e3a6b6c63 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.602995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.603605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.603879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.604142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.668351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.670328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.698932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.765238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 577/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:30.771324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:30.874531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683903a0-2f91-4086-b4f1-c5d908809eaf None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:30.897182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:30.909673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:30.910290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:30.910564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:30.910832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] PATH_INFO: `/v3/projects/8ee1132186d24c8b95c7b0c2c618b299` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:30.911985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] RBAC: Authorizing `identity:get_project(project_id=8ee1132186d24c8b95c7b0c2c618b299)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:30.913409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d986a-98fb-4f14-93a4-dab8135775f4 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:30.915055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 583/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/projects/8ee1132186d24c8b95c7b0c2c618b299 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:30.922030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:31.019844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbca63f-ec9b-42fc-ad41-54398729eb7a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:31.049233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:31.054664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:31.055255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:31.055561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:31.055835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:31.056551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=8ee1132186d24c8b95c7b0c2c618b299, user.id=2380125142c84f558a9745967fede143) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:31.056857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:31.058266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6936b3-b736-4371-9387-9f829b6afeee None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:31.064391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 578/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:30 2022] GET /identity/v3/role_assignments?user.id=2380125142c84f558a9745967fede143&scope.project.id=8ee1132186d24c8b95c7b0c2c618b299&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:33.287126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d219c3-d3ca-442a-988c-8208c37d4bcb None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.287700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d219c3-d3ca-442a-988c-8208c37d4bcb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.287700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d219c3-d3ca-442a-988c-8208c37d4bcb None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.289025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 584/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:33.295149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.295607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.295779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.314524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:33.315813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:33.384493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 579/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:33.655198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d219c3-d3ca-442a-988c-8208c37d4bcb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:33.754684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d219c3-d3ca-442a-988c-8208c37d4bcb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:33.787748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:33.788345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:33.788626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:33.788900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:33.846046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:33.856923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:33.858377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:33.954243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 585/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:33.960069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.056126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e27a4a-d0c5-4dee-be0e-6dcdb560cd5a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.081040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.090091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.091328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.091640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.091911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.098452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.099915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-b2176bb5-8c92-4c7b-9792-308b1a373db9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:34.111744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:34.113035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:34.113931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 580/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:54:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:34.118791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:34.205251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:34.214554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356fcc3-cc06-42af-8307-6256d818dc7e None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:34.249130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:34.249726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:34.250000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:34.250265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:34.250896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:34.251193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:34.252577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1375b84-0573-4d71-a1b1-eaa3f775b20c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:34.260131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 586/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Sep 7 12:54:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:36.454161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65008-f6a3-48c9-8569-1b90dcc5e331 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.459406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65008-f6a3-48c9-8569-1b90dcc5e331 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.459406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b65008-f6a3-48c9-8569-1b90dcc5e331 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.459406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 581/1167] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:36.461664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003856b3-64c4-445f-a345-28d5250896a8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.462042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003856b3-64c4-445f-a345-28d5250896a8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.462220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003856b3-64c4-445f-a345-28d5250896a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.480649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-003856b3-64c4-445f-a345-28d5250896a8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:36.481868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-003856b3-64c4-445f-a345-28d5250896a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:36.547496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:36.826030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b65008-f6a3-48c9-8569-1b90dcc5e331 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:36.950881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b65008-f6a3-48c9-8569-1b90dcc5e331 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:36.985595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:36.986198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:36.986478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:36.986749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:36.987408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:36.988787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2749d5-fdc9-4b28-a7f1-717f5fb628a5 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:37.004734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 582/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Sep 7 12:54:36 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:39.166126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa18f-93fb-4e0c-a279-b5fd17aedace None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.166654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa18f-93fb-4e0c-a279-b5fd17aedace None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.166654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa18f-93fb-4e0c-a279-b5fd17aedace None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.168052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 588/1170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:39.173869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.174284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.174401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.192734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:39.193901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:39.234281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.258899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 583/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:39.524758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa18f-93fb-4e0c-a279-b5fd17aedace None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.611636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:39.628902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa18f-93fb-4e0c-a279-b5fd17aedace None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.661191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.661808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.662084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.662356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] PATH_INFO: `/v3/domains/99e84d1d8e5b4c62b98dc89d5de0bc24` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.673352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=99e84d1d8e5b4c62b98dc89d5de0bc24)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.674785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26ed3f-6507-4a04-a972-01068e96aab7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.676389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 589/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Sep 7 12:54:39 2022] GET /identity/v3/domains/99e84d1d8e5b4c62b98dc89d5de0bc24 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:39.682178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:39.778780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dab44-894c-41a1-9249-ec30cba11434 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:39.811729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:39.812318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:39.812594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:39.812923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:39.813509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:39.814914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43b3b1-543e-4673-afcd-c1c118d4a470 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:39.841505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 584/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:54:39 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:54:42.033343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce516de-388d-4440-b4a2-dc6f805be72c None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.033877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce516de-388d-4440-b4a2-dc6f805be72c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.033877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce516de-388d-4440-b4a2-dc6f805be72c None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.035225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 590/1174] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:42.040548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.040930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.041089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.060286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:42.061711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:42.083912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:42.129075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 585/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:42.398110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce516de-388d-4440-b4a2-dc6f805be72c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.499011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce516de-388d-4440-b4a2-dc6f805be72c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.533781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.534411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.534690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.534964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] PATH_INFO: `/v3/domains/99e84d1d8e5b4c62b98dc89d5de0bc24` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.536094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=99e84d1d8e5b4c62b98dc89d5de0bc24)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.537528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111a47f-359e-42ed-9d6d-2d784ae5c0be None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.539099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 591/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Sep 7 12:54:42 2022] GET /identity/v3/domains/99e84d1d8e5b4c62b98dc89d5de0bc24 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:42.544843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:42.642353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ce359-17c4-4ecc-85b6-d07e2c9754e2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:42.676545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:42.677088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:42.677365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:42.677633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:42.678285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:42.679721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e42aa-e711-406a-9f62-df0169da4c07 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:42.701177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 586/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:54:42 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:54:44.874729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690156ae-3882-46c3-b49d-9b2e00477310 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.875241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690156ae-3882-46c3-b49d-9b2e00477310 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.875331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690156ae-3882-46c3-b49d-9b2e00477310 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.876638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 592/1178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:44.881813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:44.882208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:44.882342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:44.900585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:44.901751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:44.911370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:44.971744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 587/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:45.245699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690156ae-3882-46c3-b49d-9b2e00477310 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.260897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:45.352101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690156ae-3882-46c3-b49d-9b2e00477310 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.389533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.390166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.390448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.390723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.401743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:45.407900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:45.409007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:54:45.410030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 593/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:45.415907 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.528585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb42a37-fec2-4409-ba0a-587db9dfc2dc None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.575410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.576395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.576833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.577265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.578359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:45.579580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:45.580147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.588741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 588/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:45.597025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.696025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:45.735365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad88afc-3692-44ba-8374-b81deb3dc0b0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.776011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.776567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.776842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.777117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] PATH_INFO: `/v3/users/cdc0a2605ad4476c939d6901ad3917ff` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:45.795236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc0a2605ad4476c939d6901ad3917ff)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:45.796735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:45.798429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 594/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/users/cdc0a2605ad4476c939d6901ad3917ff => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:45.804613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:45.818557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:45.944745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859e625-3d9e-4028-9a63-b053e7ac0542 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:45.988125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:45.988729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:45.989001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:45.989291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.074005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.075393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.083003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.173113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 589/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:46.179127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.277186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742deb-5f79-43d7-b671-4f082f5ba7d8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:46.306517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.312984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:46.313600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.313873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.314139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] PATH_INFO: `/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.315227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=63a6833a3ca441f6b441cf5e07c5cdb3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.316694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7fc49-458e-40be-90ae-eee8b610f8f6 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.318304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 595/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:46.324984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:46.422866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252cd15-4c56-4a8f-b0f6-e405470a829e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:46.430090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:46.457299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:46.457889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:46.458161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:46.458425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:46.459131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=63a6833a3ca441f6b441cf5e07c5cdb3, user.id=cdc0a2605ad4476c939d6901ad3917ff) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:46.459432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:46.460865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb53ed0-7c64-4c84-8ea1-f8188ff4fe91 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:46.466113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 590/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:46 2022] GET /identity/v3/role_assignments?user.id=cdc0a2605ad4476c939d6901ad3917ff&scope.project.id=63a6833a3ca441f6b441cf5e07c5cdb3&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:48.583159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2487-b1b9-4744-b154-185378c37137 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.583681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2487-b1b9-4744-b154-185378c37137 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.583772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2487-b1b9-4744-b154-185378c37137 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.585098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 596/1186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:48.590885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:48.591754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:48.591754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:48.609653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:48.610831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:48.681346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 591/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:48.951304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2487-b1b9-4744-b154-185378c37137 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.052712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2487-b1b9-4744-b154-185378c37137 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.087971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.088590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.088867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.089136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.098953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:49.103795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:49.104975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:54:49.105898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 597/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:49.111003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.205328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.208341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d2a4-3058-44f3-b7ed-cd822d840941 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.242612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.243203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.243499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.243772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.244428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:49.244726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.246091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.254658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 592/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:49.260502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.321071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.361819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495264-8fc9-4daf-b89b-8d421b1a6571 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.394958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.395604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.395885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.396157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] PATH_INFO: `/v3/users/cdc0a2605ad4476c939d6901ad3917ff` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.397270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] RBAC: Authorizing `identity:get_user(user_id=cdc0a2605ad4476c939d6901ad3917ff)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.398709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.400317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 598/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/users/cdc0a2605ad4476c939d6901ad3917ff => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:54:49.406160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.506324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcc11d-4147-4400-8501-5c37b6d845e3 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.539827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.540450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.540727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.540999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] PATH_INFO: `/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.542105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] RBAC: Authorizing `identity:get_project(project_id=63a6833a3ca441f6b441cf5e07c5cdb3)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.544430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3d0fe-aea7-403b-9202-a2bacc705573 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.546079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 593/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:49 2022] GET /identity/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:49.551992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:49.650667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d983-8f3f-41d6-8f5d-05e804ca6af9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:49.676935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:49.685949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:49.686853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:49.687132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:49.687406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] PATH_INFO: `/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3/users/cdc0a2605ad4476c939d6901ad3917ff/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:49.689466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=63a6833a3ca441f6b441cf5e07c5cdb3, user_id=cdc0a2605ad4476c939d6901ad3917ff, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:49.690896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521470c-c934-49e5-92b4-31627b3b57c1 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:49.703278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 599/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:54:49 2022] PUT /identity/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3/users/cdc0a2605ad4476c939d6901ad3917ff/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:54:51.845118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffe74-3a7f-4840-96de-a6a9cdfe45e9 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.845642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffe74-3a7f-4840-96de-a6a9cdfe45e9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.845642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdffe74-3a7f-4840-96de-a6a9cdfe45e9 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.846905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 594/1193] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:54:51.852176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:51.852581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:51.852733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:51.871428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:54:51.872652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:54:51.937556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 600/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:54:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:54:52.208281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdffe74-3a7f-4840-96de-a6a9cdfe45e9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.239208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.316754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdffe74-3a7f-4840-96de-a6a9cdfe45e9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.351432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.352076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.352355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.352627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.363254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:54:52.368130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:54:52.369207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:54:52.370266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 595/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:54:52.375582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.471823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee084f8-3009-4ba1-b07d-bbbede3e705b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.487277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.505097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.505692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.505971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.506241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.506892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:52.507193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.508587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.516943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 601/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:52.523012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.613241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.623929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804c5fa-0511-4791-af29-6f6840794b36 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.662895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.663551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.663830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.664100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] PATH_INFO: `/v3/users/cdc0a2605ad4476c939d6901ad3917ff` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.665332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] RBAC: Authorizing `identity:get_user(user_id=cdc0a2605ad4476c939d6901ad3917ff)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.666742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.668662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 596/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/users/cdc0a2605ad4476c939d6901ad3917ff => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:52.674599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:52.772801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a6df-0b69-4d49-8391-a3ea9e0c1250 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:52.804396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:52.804982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:52.805257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:52.805523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:52.850916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:52.872828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:52.874274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:52.971492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 602/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:54:52.977681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.090966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d752e0-d99f-4b88-b11f-31c0699ae61a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.123721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.124336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.124606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.124870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] PATH_INFO: `/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.125962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] RBAC: Authorizing `identity:get_project(project_id=63a6833a3ca441f6b441cf5e07c5cdb3)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.127359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fa0cc-883c-4597-9257-ce0e35a1879e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.129045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 597/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Sep 7 12:54:52 2022] GET /identity/v3/projects/63a6833a3ca441f6b441cf5e07c5cdb3 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:54:53.135185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:54:53.212489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:54:53.234713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706337d6-6b4f-483d-82b1-022075e18be7 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:54:53.267837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:54:53.268421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:54:53.268692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:54:53.268957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:54:53.269655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=63a6833a3ca441f6b441cf5e07c5cdb3, user.id=cdc0a2605ad4476c939d6901ad3917ff) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:54:53.269954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:54:53.271365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fe6db-dae3-4da8-8e0d-d3958bcccf66 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:54:53.276904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 603/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:54:53 2022] GET /identity/v3/role_assignments?user.id=cdc0a2605ad4476c939d6901ad3917ff&scope.project.id=63a6833a3ca441f6b441cf5e07c5cdb3&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:03.119565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=87 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:03.274368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=29 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:49.866711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c802-f9a5-4f76-a4ec-48a6191f020b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:49.867268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c802-f9a5-4f76-a4ec-48a6191f020b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:49.867268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647c802-f9a5-4f76-a4ec-48a6191f020b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:49.868901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 598/1201] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:49.874210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:49.874768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:49.874768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:49.896475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:49.897681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:49.987866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 604/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:50.263348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c802-f9a5-4f76-a4ec-48a6191f020b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:50.391036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647c802-f9a5-4f76-a4ec-48a6191f020b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:50.428743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:50.429399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:50.429676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:50.429947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:50.450220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:50.452076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:50.468268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:50.469387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:50.470349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:50.470349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:50.470349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:55:50.472632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 599/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:50.478453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:50.630786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45cec7-00d1-4a64-aa77-83923eb66659 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:50.662000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:50.668697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:50.669322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:50.670221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:50.670221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:50.670891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:50.671192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:50.672939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2adcb-24b7-4bef-adff-356ed5db02ba None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:50.686114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 605/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:55:50.692625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:50.754711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:50.827454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acecb50-57f0-4db5-abb6-5476146c2639 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:50.873054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:50.873736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:50.873972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:50.874220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:50.874885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:50.876333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608ee6-8c3c-4626-9c34-47fe52331d44 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:50.915971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 600/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Sep 7 12:55:50 2022] POST /identity/v3/users => generated 251 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:55:53.330536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab214d-e803-4819-9a30-8b868207cf75 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:53.331128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab214d-e803-4819-9a30-8b868207cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:53.331128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab214d-e803-4819-9a30-8b868207cf75 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:53.332647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 606/1206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:53.338169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:53.338796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:53.338796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:53.357991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:53.359286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:53.434973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 601/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:55:53.780188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab214d-e803-4819-9a30-8b868207cf75 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:53.912102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab214d-e803-4819-9a30-8b868207cf75 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:53.951633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:53.952907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:53.952907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:53.953114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:53.964030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:53.968954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:53.971526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:53.972588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 607/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:53.976688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.022212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:54.096637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355593a-08c9-4a5a-a9ac-049944cd7d35 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:54.135806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:54.136813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.137096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.137371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.138040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:54.138344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:54.139821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:54.148451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 602/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:55:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:54.154968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.212246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:54.285258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ec6b-8630-4725-a636-c129b11435c6 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:54.325815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:54.326495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.326873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.327274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.339809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:54.341614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:54.359327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:54.360468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:54.361365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:54.361365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:54.361365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:54.361365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 608/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:54.367038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.485509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:54.489058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c260-e9fd-4f02-a118-fbdf4c0280cb None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:54.531995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:54.532620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.532956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.533230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.533874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:54.534175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:54.535714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:54.550038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 603/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:54.556171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.676169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fffc9-1c1e-432f-a071-a62bf1246890 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:54.677772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:54.716199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:54.716862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.717132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.717400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.727039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:54.731729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:54.748467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:54.749580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:54.755672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 609/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:54.756313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:54.901716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6519b9f-10ce-4b73-86cb-4a7620b5e544 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:54.942357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:54.942891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:54.943171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:54.943534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:54.944514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:54.944844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:54.947391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:54.977101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 604/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:54.984212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.112491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28baff-45b4-4a1e-a483-dc218b11622c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.149716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.150640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.151535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.152091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.188121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.229993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.231551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.357501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 610/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:55:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:55:55.363484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.383493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.482451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01560-8e2c-4094-9b00-aacb840d9c89 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.545587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.546336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.546695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.547156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.559101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.561034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:55.578250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:55.579601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:55.580522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:55.580522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:55.580522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:55:55.580522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 605/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:55:55.587055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.659672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.710953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05acb4-2105-4aa0-ac5d-83b1e93af3f9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.753100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.753626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.753903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.754172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.754807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:55.755105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.756490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:55.770693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 611/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:55.777377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:55.882028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:55.935492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120eac1-1f91-4d83-93ec-76bc9ab476ec None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:55.978157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:55.979442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:55.979819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:55.980143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:55.989486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:55.991190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:55:56.006523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:56.007573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:55:56.013738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 606/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:56.014259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:56.143714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18d8e5-2f43-4efb-a3ef-f95bcb274154 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:56.170763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:56.184205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:56.184812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:56.185088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:56.185356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:56.186372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:56.186665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:56.188237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ec326-8aa4-4f33-8d94-d839856f722c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:56.201718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 612/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:55:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:56.208170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:56.317271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8b0a-272a-4699-903c-a9f0696abf44 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:56.351435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:56.360207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:56.360839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:56.361119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:56.361387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:56.362191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=446b38e21f4a48f29107e4a6deb1ce00) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:56.362492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:56.363976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f75a58-40a8-4678-a505-f5b3cf8accf8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:56.371866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 607/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:55:56 2022] GET /identity/v3/role_assignments?user.id=446b38e21f4a48f29107e4a6deb1ce00&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:58.582517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f76c1-3ae6-43b8-92ae-1ea59a6ce705 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.583069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f76c1-3ae6-43b8-92ae-1ea59a6ce705 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.583206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f76c1-3ae6-43b8-92ae-1ea59a6ce705 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:58.584775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 613/1220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:55:58.591131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:58.591606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:58.591854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:58.611532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:55:58.612853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:55:58.696611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 608/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:55:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:55:58.991512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f76c1-3ae6-43b8-92ae-1ea59a6ce705 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.106669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f76c1-3ae6-43b8-92ae-1ea59a6ce705 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.153036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.153878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.154367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.154807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.168084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:55:59.172948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:59.174092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:59.175331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 614/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:55:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:59.180567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.296911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336b2b2-e677-4cf4-a57a-f5874c7ad4dd None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.321695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.332472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.333811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.333811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.333811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.334448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] RBAC: Adding query filter params (name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:59.334745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.336119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.345525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 609/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:59.351411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.403662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.467971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0210ff-0cdf-4d32-9397-858aeefd8077 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.504620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.505253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.505531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.505843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.516576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.518501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:55:59.538690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:59.540012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:55:59.540898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:55:59.540898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:55:59.540898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:59.545470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 615/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:59.546685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.665639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56380944-f241-4230-8690-b8de6ad6e832 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.709404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.710479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.711024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.711531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.712684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:55:59.713948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.716761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.733462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 610/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:55:59.740241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.855021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:55:59.864716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c770e-9b7f-44ed-890d-8098d05a551c None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:55:59.906994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:55:59.907631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:55:59.907906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:55:59.908171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:55:59.916802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:55:59.918502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:55:59.930903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:55:59.932056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:55:59.935197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 616/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:55:59.938736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:55:59.991782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:00.050441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56b7a6-ba08-429f-b100-9a5f4e69838e None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:00.085723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:00.086322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:00.086597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:00.086864 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:00.087608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:00.087911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:00.090249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:00.110075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 611/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:55:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:00.116866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:00.227247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d22f6-1c2d-4aff-98f0-6f26c27b8b18 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:00.269600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:00.270447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:00.270763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:00.271032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:00.284177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:00.285788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:00.302491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:00.303738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:00.304843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:00.304843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:00.304843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:00.304843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 617/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:00.310500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:00.424047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18cb3-6e76-40ba-abd0-334753ef6080 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:00.426824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:00.462833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:00.463619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:00.463898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:00.464170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:00.464815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:00.465117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:00.466479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:00.477908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 612/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:00.484578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:00.496196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:00.597813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796b63-77f7-4c54-b1f9-1759b364a8a9 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:00.633374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:00.633996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:00.634315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:00.634532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:00.641340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:00.642784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:56:00.653956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:00.655041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:00.655997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 618/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:00.661181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:00.797767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8410c-1b1d-48ba-af7e-ae063e3bad3c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:00.834102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:00.834714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:00.835083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:00.835280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:00.835983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:00.836288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:00.837748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7522d-fc7b-45da-b657-dc6ea8ec938a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:00.851402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 613/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:56:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:00.859046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:00.933970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:00.971687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016d5a6-ace5-4e5c-8221-e5ad8e3e5838 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:01.009625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:01.010349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:01.010634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:01.010906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/446b38e21f4a48f29107e4a6deb1ce00/roles/1fcd3fe4a5f7416b85b6cced51562f01` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:01.028106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=446b38e21f4a48f29107e4a6deb1ce00, role_id=1fcd3fe4a5f7416b85b6cced51562f01)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:01.029552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8654a-b357-42e3-84d6-22648981395c None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:01.043105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 619/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:56:00 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/446b38e21f4a48f29107e4a6deb1ce00/roles/1fcd3fe4a5f7416b85b6cced51562f01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:56:03.348024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9835a71-5784-4c4b-9d7a-e9b8e3776d59 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:03.348577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9835a71-5784-4c4b-9d7a-e9b8e3776d59 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:03.348577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9835a71-5784-4c4b-9d7a-e9b8e3776d59 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:03.350398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 614/1233] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:03.356894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:03.357343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:03.357573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:03.377501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:03.378832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:03.462392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 620/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:56:03.772606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9835a71-5784-4c4b-9d7a-e9b8e3776d59 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:03.804474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:03.902827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9835a71-5784-4c4b-9d7a-e9b8e3776d59 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:03.944264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:03.944964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:03.945291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:03.945596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:03.957356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:03.963051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:03.964668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:56:03.965713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:03.971216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 615/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Sep 7 12:56:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:03.972529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:04.024328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:04.082086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d53f-150a-4f8c-aa99-d3e20f037aa3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:04.118184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:04.118920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:04.119158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:04.119641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:04.120384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] RBAC: Adding query filter params (name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:04.120685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:04.122059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:04.130663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 621/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Sep 7 12:56:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:04.137271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:04.238025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:04.254560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c201-2d58-4c40-be5d-2eb5c7201285 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:04.290037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:04.290676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:04.290972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:04.291931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:04.303574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:04.305651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:04.324412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:04.325669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:04.326584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:04.326584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:04.326584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:04.326584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 616/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:04.332206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:04.446448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c332ea-28f3-45a6-a6be-c5ebd500313a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:04.455666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:04.484075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:04.484810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:04.485098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:04.485442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:04.486176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:04.486474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:04.488090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:04.502086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 622/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:56:04.508142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:04.623932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2590d-e2f7-4048-b4a3-4b4b05532ab7 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:04.667671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:04.668357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:04.668667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:04.669014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:04.671988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:04.678035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:04.679875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:56:04.692847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:04.694188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:04.695545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:04.699427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 617/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:04.700576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:04.821681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4cd6b-45f0-430b-b9b9-7182531b9778 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:04.864747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:04.865358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:04.865637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:04.865906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:04.866679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:04.867168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:04.868522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:04.890649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 623/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:56:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:04.897269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.018354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205bf53-73dc-4a9a-a9bd-ef74b054dbac None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.055728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.056550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.056908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.057285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.126057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.133750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:05.136047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:05.248093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 618/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:05.254082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.284598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.371945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475b15-7da0-484b-be85-85b5ed83a415 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.415306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.416164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.416610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.416920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.428515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:05.430245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:05.448847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:05.450375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:05.451544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:05.451544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:05.451544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:05.451544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 624/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:05.457330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.566324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.574183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a26a-99c9-44c4-bb2e-47b09497bdc2 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.614867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.615573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.615900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.616265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.616959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:05.617417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:05.618904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:05.633077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 619/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:05.639992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.731073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:05.754492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e98d9-650c-45ed-956d-27f43ef9c97f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.793088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.793644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.793923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.794194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:05.802075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:05.803817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:56:05.817430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:05.818433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:05.819527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 625/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:56:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:05.824905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:05.959310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff4b51-af37-46b4-90fd-9b01541005c4 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:05.998207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:05.998865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:05.999215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:05.999552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:06.000301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:06.000603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:06.002082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e883efd-60bc-42f7-85d5-adf0163846e4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:06.015989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 620/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:56:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:06.022858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:06.138921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af00a-795c-4a48-9b35-4ce6c72532ce None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:06.179412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:06.180161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:06.180496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:06.180705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:06.181680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] RBAC: Adding query filter params (role.id=1fcd3fe4a5f7416b85b6cced51562f01, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=446b38e21f4a48f29107e4a6deb1ce00) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:06.182078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:06.184367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdf3c5-6196-4967-a6dc-be66164589ba None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:06.190922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 626/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:06 2022] GET /identity/v3/role_assignments?user.id=446b38e21f4a48f29107e4a6deb1ce00&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=1fcd3fe4a5f7416b85b6cced51562f01 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:08.628218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2905-81ad-46c0-8133-bf0ad827bdd4 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:08.628761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2905-81ad-46c0-8133-bf0ad827bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:08.629026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2905-81ad-46c0-8133-bf0ad827bdd4 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:08.630698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 621/1247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:56:08.636301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:08.636739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:08.636857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:08.643536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:08.657251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:08.658518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:08.732646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 627/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:09.053297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2905-81ad-46c0-8133-bf0ad827bdd4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.074319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.166869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2905-81ad-46c0-8133-bf0ad827bdd4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.204689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.204689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.204990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.205065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.216055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:09.221388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:09.222565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:09.223447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 622/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:09.229075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.337445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be2242-cc12-4982-9554-86e6026410c8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.368307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.375614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.376234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.376858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.377033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.377736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:09.378041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.379784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.389438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 628/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:09.395629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.485340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.515186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a20636-58ad-438e-88e3-d92a7ee6ffd8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.561503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.562218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.562558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.562930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.574622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.576303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:09.591937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:09.593124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:09.594228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:09.594228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:09.594228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:09.594228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 623/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:56:09.601308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.724080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa08fd5-74d6-45e1-9135-bc5c836299c0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.763279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.763935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.764211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.764485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.765138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:09.765438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.766844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.780949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 629/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:09.786890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:09.906806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c612a-f167-4104-86ae-9d828397f47b None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:09.936624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:09.945011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:09.945653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:09.945928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:09.946197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:09.954971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:09.956456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:56:09.969437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:09.970644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:09.971814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:09.975594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 624/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:56:09.976684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.036595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.084245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef28b0-52e2-447b-aa65-6b6ae789885b None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.121990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.122807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.123215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.123675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.124609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:10.125043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.126647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.146459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 630/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:56:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:10.156351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.266352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d111aaa-67c7-4860-b511-32da58fed00c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.305721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.306328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.306605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.307776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.365145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.379103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.380627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.484945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 625/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:10.490980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.598192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f8763-8772-433b-ba5e-b2cf3595e152 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.612563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.634298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.635071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.635622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.635911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.648695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.650155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:10.667542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:10.668690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:10.669605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:10.669605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:10.669605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:10.669605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 631/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:10.674590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.759264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:10.771547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972eeee-ab5d-4c1a-8e3d-28e2ba1a8c0a None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.805719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.806327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.806879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.807138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.807788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:10.808083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:10.809417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:10.820643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 626/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:10.828058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:10.956623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e17ac-cca8-4ed8-a7a2-b7996c5b03a2 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:10.990845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:10.991479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:10.991780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:10.992047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:10.998523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:11.000019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:56:11.012414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:11.013425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:11.014666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 632/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:11.019396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:11.117718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d754-7c0d-45c3-8848-6ea386c323e9 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:11.150210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:11.151484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:11.151749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:11.152016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:11.152694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:11.152994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:11.154405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092b122-aacf-432f-a976-b55f5d646fd4 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:11.165934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 627/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:56:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:11.172211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:11.198042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:11.271992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77495d-a819-4d5b-9899-49ccd3773e49 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:11.305086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:11.305678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:11.305952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:11.306218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:11.307442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=446b38e21f4a48f29107e4a6deb1ce00) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:11.307773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:11.309193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b3cb4-7206-4e9f-80d0-2bf01c8d09be None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:11.314797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 633/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:11 2022] GET /identity/v3/role_assignments?user.id=446b38e21f4a48f29107e4a6deb1ce00&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:13.466099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404008-d6c1-4d19-b1bf-79da76345343 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.466632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404008-d6c1-4d19-b1bf-79da76345343 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.466632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49404008-d6c1-4d19-b1bf-79da76345343 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.468019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 628/1261] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:13.473039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.473422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.473587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:13.492066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:13.493253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:13.559610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 634/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:13.831502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404008-d6c1-4d19-b1bf-79da76345343 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:13.844310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:13.956529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49404008-d6c1-4d19-b1bf-79da76345343 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:13.989628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:13.990289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:13.990577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:13.990878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.001698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:14.006490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:14.007624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:14.008518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 629/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:14.013740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.031570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.110199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28927f0-2641-482b-8233-6204cf10ac1f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.143096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.143714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.143993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.144265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.144911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:14.145210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.146566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.154666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 635/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:14.160390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.226001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.260220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f0137-e6ae-406a-8597-e805bd0652da None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.293086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.293695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.293968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.294234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.303940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.305354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:14.320976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:14.322117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:14.324033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:14.324033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:14.324033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:14.324033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 630/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:14.328950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.410498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.429695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8980-7bbb-44db-b48b-c9e55bf25b9d None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.463798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.464410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.464694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.464967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.465606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:14.465910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.467276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.479345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 636/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:14.485079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.589423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b1aee-2c86-4d45-a994-1949947b0b40 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.608367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.622853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.623492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.623757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.624019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.631196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.632617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:56:14.643921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:14.645022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:14.645982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 631/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:14.651083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.749295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997256cc-b2d6-4a46-9c3d-1d2fa3941946 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.781423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.782014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.782286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.782551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.783257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:14.783583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.784991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.794065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:14.803182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 637/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:14.809623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:14.912745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020fa24-6b10-4e9c-b3f8-e5a8a649d64d None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:14.946535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:14.947182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:14.948151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:14.948425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:14.958713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:14.960172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:14.974007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:14.975126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:14.976071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:14.976071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:14.976071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:14.976071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 632/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:14.981413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:15.082795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e98d-9236-42bb-88bf-609b2373b28a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:15.116703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:15.117289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:15.117563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:15.117830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:15.118450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:15.118743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:15.120354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:15.132716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 638/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:15.138417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:15.170926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:15.239194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73e158-5b69-447e-aa86-6f699749d148 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:15.271475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:15.272093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:15.272372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:15.272639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:15.279867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:15.281281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:56:15.293001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:15.294045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:15.295276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 633/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:15.301425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:15.360168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:15.401848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d9407-f00c-4f14-b733-e621a7a746ac None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:15.434694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:15.435277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:15.435845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:15.436114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:15.436788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:15.437087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:15.438497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec60f3-20d5-41b8-9f99-9da6897e7e6d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:15.450724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 639/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:15.456699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:15.549217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:15.558520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee785-297e-4550-867d-f38ad2754869 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:15.591857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:15.592504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:15.592776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:15.593121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] PATH_INFO: `/v3/projects/e493059295a84a8785338deeca98abe5/users/446b38e21f4a48f29107e4a6deb1ce00/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:15.594896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] RBAC: Authorizing `identity:create_grant(project_id=e493059295a84a8785338deeca98abe5, user_id=446b38e21f4a48f29107e4a6deb1ce00, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:15.596326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712208b4-fe2f-4b24-b936-eea24c028452 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:15.609441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 634/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Sep 7 12:56:15 2022] PUT /identity/v3/projects/e493059295a84a8785338deeca98abe5/users/446b38e21f4a48f29107e4a6deb1ce00/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:56:17.751627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2796-0968-4498-a533-e8549bbe4aa6 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.752169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2796-0968-4498-a533-e8549bbe4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.752169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c2796-0968-4498-a533-e8549bbe4aa6 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.753507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 640/1274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:17.758771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:17.759159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:17.759315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:17.777798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:17.778901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:17.850090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 635/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:56:18.131325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c2796-0968-4498-a533-e8549bbe4aa6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.229850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c2796-0968-4498-a533-e8549bbe4aa6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:18.246530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:18.262841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:18.263455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:18.263755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:18.264021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:18.273788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:56:18.279101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:18.280248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:18.281119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 641/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:18.286143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.370488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:18.388870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2403303-45f4-4784-9118-b0618c927a31 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:18.422817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:18.423410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:18.423709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:18.423975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:18.424627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:18.424922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:18.426252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:18.434166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 636/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:18.440297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.543010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb593c-9b35-4b81-8e25-721caecc1433 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:18.576883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:18.577492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:18.577769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:18.578042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:18.587922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:18.589959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:18.604346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:18.605483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:18.606371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:18.606371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:18.606371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:18.606371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 642/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:18.611193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.710709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274bb54-6812-4ff8-acfe-14dab863459c None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:18.744520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:18.745118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:18.745395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:18.745663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:18.746297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:18.746603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:18.747977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:18.759342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 637/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:18.765771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.796130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:18.864789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd340ac-e7f1-4cfd-abce-62a438fe52f8 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:18.898220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:18.898832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:18.899105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:18.899371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:18.907729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:18.909145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:56:18.920096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:18.921192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:18.922163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 643/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:18.927101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:18.930882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.028905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe221-07dd-4d9d-a8d4-9c8aa619d995 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:19.062339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:19.062933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:19.063207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:19.063504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:19.064218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:19.064519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:19.065917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:19.082860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 638/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Sep 7 12:56:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:19.088705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:19.176961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.187338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa0a67-4949-4a71-9f29-d59e3977d09f None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:19.220648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:19.221245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:19.221521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:19.221787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:19.286238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:19.287635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:19.373999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.384868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 644/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Sep 7 12:56:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:56:19.390600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:19.450547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.489245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f79c0-6479-4678-84c7-a9cb8fdd69b8 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:19.522845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:19.523479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:19.523766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:19.524038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:19.534793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:19.536302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:56:19.552252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:19.553264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:56:19.554323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:56:19.554323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:56:19.554323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:19.554323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 639/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 12:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:19.559149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:19.655734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43797e-333c-4ae6-ae8a-78bc5c944899 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:19.688604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:19.689186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:19.689462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:19.689726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:19.690352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:19.690647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:19.692054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:19.703072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 645/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Sep 7 12:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:19.708869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:19.809061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc11a14-c390-4fb2-9674-b792bf5280ea None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:19.823063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.844330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:19.844949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:19.845229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:19.845497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:19.851964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:19.853433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:56:19.865226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:19.866281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: ERROR keystone.server.flask.application Sep 07 12:56:19.867503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 640/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Sep 7 12:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:19.872683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:19.923161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:19.974851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeac8e-784e-4330-ae1c-36caa76f6e4a None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:20.008772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:20.009366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:20.010358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:20.010622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:20.011298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:20.011634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:20.013051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6729-b638-4217-91b9-4fa10028cf10 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:20.024905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 646/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Sep 7 12:56:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:20.031898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:20.129195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4e5a7-0a2d-4aa7-acdc-de9ca809731f None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:20.162123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:20.162705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:20.162975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:20.163239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:20.163969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] RBAC: Adding query filter params (role.id=9bb543c39d404aa2ad93eb8abd213cee, scope.project.id=e493059295a84a8785338deeca98abe5, user.id=446b38e21f4a48f29107e4a6deb1ce00) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:20.164270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:20.165663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c6908-4a31-4034-809d-98f25d1a8518 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:20.171352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 641/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Sep 7 12:56:20 2022] GET /identity/v3/role_assignments?user.id=446b38e21f4a48f29107e4a6deb1ce00&scope.project.id=e493059295a84a8785338deeca98abe5&role.id=9bb543c39d404aa2ad93eb8abd213cee => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:22.342397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34953-0d13-4156-96d4-aa242ee66553 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:22.342936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34953-0d13-4156-96d4-aa242ee66553 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:22.342936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf34953-0d13-4156-96d4-aa242ee66553 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:22.344366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 647/1288] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:22.350056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:22.350551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:22.351037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:22.373616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:22.374791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:22.403064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:22.440673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 642/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:22.716930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34953-0d13-4156-96d4-aa242ee66553 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:22.817794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf34953-0d13-4156-96d4-aa242ee66553 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:22.829816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:22.856222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:22.856955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:22.857352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:22.857544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:22.858233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:22.860115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:22.872144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:22.874263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:22.875140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 648/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:56:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:22.881019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:22.982862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e9480-ab15-48c5-9ff3-f0577fcefa0b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:23.019930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:23.020536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:23.020811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:23.021084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:23.021819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:23.022367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:23.024887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6ad06-ecdd-450c-8c94-7af7fbdbe5ee None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:23.030290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 643/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Sep 7 12:56:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:23.036166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:23.137979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cc58-796a-477f-b8dc-5dea18b12fa0 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:23.174620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:23.175214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:23.175512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:23.175785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] PATH_INFO: `/v3/services` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:23.176403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:23.176702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:23.178226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26b40a-80e2-4334-8db6-02da3a64415d None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:23.183313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 649/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Sep 7 12:56:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:25.328625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b74f-edc4-4897-84a4-6227585d0b8b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:25.329179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b74f-edc4-4897-84a4-6227585d0b8b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:25.329179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b74f-edc4-4897-84a4-6227585d0b8b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:25.330537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 644/1293] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:25.335647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9bab5-8ac5-4404-87c0-cd2858e87564 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:25.336009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9bab5-8ac5-4404-87c0-cd2858e87564 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:25.336197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9bab5-8ac5-4404-87c0-cd2858e87564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:25.354996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2ee9bab5-8ac5-4404-87c0-cd2858e87564 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:25.356219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2ee9bab5-8ac5-4404-87c0-cd2858e87564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:25.386819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:25.436387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 650/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:25.701713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b74f-edc4-4897-84a4-6227585d0b8b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:25.733511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:25.817348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38b74f-edc4-4897-84a4-6227585d0b8b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:25.854605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:25.855257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:25.855558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:25.855824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:25.856500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:25.857976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac41679-c15a-4b25-9d8b-369d4c961d61 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:25.875849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 645/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Sep 7 12:56:25 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:56:28.028964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf920-2bb9-44ce-8306-7982f253eb76 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:28.029528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf920-2bb9-44ce-8306-7982f253eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:28.029528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cf920-2bb9-44ce-8306-7982f253eb76 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:28.030857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 651/1296] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:28.036166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:28.036593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:28.036695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:28.055702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:28.056896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:28.126057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 646/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:56:28.394849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cf920-2bb9-44ce-8306-7982f253eb76 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:28.503882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cf920-2bb9-44ce-8306-7982f253eb76 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:28.537523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:28.538147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:28.538427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:28.538699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:28.539275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:28.540672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:28.549956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:28.551304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:28.552449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 652/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:56:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:28.556991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:28.575454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:28.657055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ace0e-8542-42c5-a93f-1e1bf6413c23 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:28.692238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:28.692832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:28.693105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:28.693370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:28.693981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:28.694275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:28.695639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:28.700601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 647/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Sep 7 12:56:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:28.706736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:28.739080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:28.806185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba2670-4d60-4e33-97be-2126b4c8debc None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:28.843421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:28.844352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:28.844784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:28.845249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:28.846222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] RBAC: Adding query filter params (interface=public, service_id=c7cec9378425499c99662b2975aca7df, region_id=RegionOne) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:28.846649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:28.848775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cd00b-cb84-4952-a7bd-6766f21dbc23 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:28.856585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 653/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Sep 7 12:56:28 2022] GET /identity/v3/endpoints?service_id=c7cec9378425499c99662b2975aca7df&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:28.862764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:28.953045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:28.971656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73daff4d-0a58-440a-bca2-4ad754743683 None admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:29.004470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:29.005058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:29.005335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:29.005606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:29.006202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:29.007572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d67c9f-d12c-4714-9013-6b7ac1296586 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:29.014729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 648/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Sep 7 12:56:28 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 12:56:31.149833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa1004-ab9d-44d2-bd02-022853b78cf2 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:31.150475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa1004-ab9d-44d2-bd02-022853b78cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:31.150579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa1004-ab9d-44d2-bd02-022853b78cf2 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:31.151935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 654/1302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:56:31.157203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:31.157626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:31.157751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:31.176129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:56:31.177308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:56:31.242897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 649/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:56:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:56:31.512244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa1004-ab9d-44d2-bd02-022853b78cf2 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:31.609360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:31.616589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa1004-ab9d-44d2-bd02-022853b78cf2 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:31.648965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:31.649581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:31.649860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:31.650749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:31.651323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:31.652724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:56:31.661354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:56:31.662560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application with Lock( Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: ERROR keystone.server.flask.application Sep 07 12:56:31.663631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 655/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Sep 7 12:56:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:56:31.669216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:31.745561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:31.767797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de4b0-3457-4c87-82ea-6dd49a286b26 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:31.801029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:31.801626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:31.801901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:31.802169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] PATH_INFO: `/v3/services` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:31.802789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:56:31.803086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:31.804458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d2e1-ee9c-41f7-b3fd-a56763c48e28 None admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:31.809505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 650/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Sep 7 12:56:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:56:31.815589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:56:31.911976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cbc72-586f-4a1a-b387-82096545e511 None admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:56:31.944275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:56:31.944861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:56:31.945134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:56:31.945398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:56:31.946052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:56:31.947946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00064837-fc40-4734-82fb-91bd054b54b9 None admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:56:31.967381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 656/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 12:56:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:56:41.806519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=30 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:56:41.963324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:36.641145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3dd5-dfa6-460a-a714-4227010247a7 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:36.641620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3dd5-dfa6-460a-a714-4227010247a7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:36.641707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d3dd5-dfa6-460a-a714-4227010247a7 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:36.646914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 651/1307] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:36.648259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd41c-2328-477f-a74c-44a72577520e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:36.649406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd41c-2328-477f-a74c-44a72577520e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:36.649674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd41c-2328-477f-a74c-44a72577520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:36.796413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-297fd41c-2328-477f-a74c-44a72577520e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:36.797623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-297fd41c-2328-477f-a74c-44a72577520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:36.905669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 657/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:57:37.205167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:37.205514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:37.205707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:37.207209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 652/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Sep 7 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:37.213900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0da3d-26f5-4557-926a-2a0885971ee1 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:37.214293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0da3d-26f5-4557-926a-2a0885971ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:37.214475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0da3d-26f5-4557-926a-2a0885971ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:37.315658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a3a0da3d-26f5-4557-926a-2a0885971ee1 None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:37.316872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a3a0da3d-26f5-4557-926a-2a0885971ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:37.346092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:37.419000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 658/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Sep 7 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:37.429273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:37.431771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:37.572206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a4cbf-80cd-4411-a13f-f57d5b2850f4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:37.655387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:37.656044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:37.656342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:37.656515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:37.658126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:37.727252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:37.798151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:37.799273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda2ee-2f17-4d42-81e1-30d59838e206 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:37.826216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 653/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:40.313093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:40.313604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:40.313604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:40.314886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 659/1312] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:40.320872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c922-cb8a-4c63-bacd-f2174d543a98 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:40.321322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c922-cb8a-4c63-bacd-f2174d543a98 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:40.321417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c922-cb8a-4c63-bacd-f2174d543a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:40.403783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a381c922-cb8a-4c63-bacd-f2174d543a98 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:40.405220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a381c922-cb8a-4c63-bacd-f2174d543a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:40.503190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 654/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:57:40.795453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:40.797019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:40.909920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afd70c-8eda-4cd8-94e5-16b866a2c5cb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:40.994752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:40.997875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:40.998696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:40.999131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:40.999625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:41.001266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:41.114910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:41.116384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d8717-94bc-492d-b243-3768e28c09c7 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:41.136102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 660/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:43.605434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34556a-6daa-46e2-abc8-e9e4877cbccb None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:43.605985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34556a-6daa-46e2-abc8-e9e4877cbccb None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:43.605985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34556a-6daa-46e2-abc8-e9e4877cbccb None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:43.607346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 655/1315] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:43.612659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3f56-a87f-4c34-a732-da0feac9a23e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:43.613038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3f56-a87f-4c34-a732-da0feac9a23e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:43.613209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f3f56-a87f-4c34-a732-da0feac9a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:43.678213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-402f3f56-a87f-4c34-a732-da0feac9a23e None None] MFA Rules not processed for user `a2a1a361ba2441d093ccdff3013d4adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:43.679400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-402f3f56-a87f-4c34-a732-da0feac9a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:43.731829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:43.776056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 661/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:44.074181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:44.074465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:44.074736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:44.076131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 656/1317] 10.222.0.18 () {54 vars in 965 bytes} [Wed Sep 7 12:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:44.082161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0465e8-777a-445e-8829-f7ac9f1de20f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:44.082449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0465e8-777a-445e-8829-f7ac9f1de20f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:44.083203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0465e8-777a-445e-8829-f7ac9f1de20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:44.160450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7e0465e8-777a-445e-8829-f7ac9f1de20f None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:44.161656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7e0465e8-777a-445e-8829-f7ac9f1de20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:44.236540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 662/1318] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Sep 7 12:57:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:44.246245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:44.247823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:44.257455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:44.354358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a275a-f76a-49da-bbf1-c91e35a8dc9f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:44.428213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:44.428812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:44.429090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:44.429362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:44.431640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:44.495332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:44.543825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:44.545253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d41325-31cf-4a81-8eb8-95a113bd5cdd service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:44.564253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 657/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:47.691674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.692241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.692241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.693570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 663/1320] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:47.700479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a33fd-4d1a-442f-9e59-a2ba391b90d8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:47.700963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a33fd-4d1a-442f-9e59-a2ba391b90d8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:47.701059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a33fd-4d1a-442f-9e59-a2ba391b90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:47.779325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6d2a33fd-4d1a-442f-9e59-a2ba391b90d8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:47.781059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6d2a33fd-4d1a-442f-9e59-a2ba391b90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:47.904334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 658/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:48.209041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:48.210575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:48.261278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:48.316038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba434192-0565-47e8-9d56-45560c8a6812 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:48.388526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:48.389142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:48.389419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:48.389684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:48.391269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:48.491836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:48.506261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:48.507984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff554b-1cb0-4c13-9c41-a2c7b90603f8 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:48.526562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 664/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:51.429362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.429888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.429888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.431885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 659/1323] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:51.437681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7dcf-77c2-48dc-af5c-17f0270a00b6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.438111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7dcf-77c2-48dc-af5c-17f0270a00b6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.438226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc7dcf-77c2-48dc-af5c-17f0270a00b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.530084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6edc7dcf-77c2-48dc-af5c-17f0270a00b6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:51.531316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6edc7dcf-77c2-48dc-af5c-17f0270a00b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:51.641807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 665/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:51.931554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:51.933109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:51.953654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:52.042299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ae44-3513-40ef-9a14-107a07f1e53e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:52.118407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:52.119006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:52.119285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:52.119581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:52.121253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:52.194283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:52.233281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:52.234710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc816f58-3431-47ab-9c2d-fe1d226b250c service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:52.252746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 660/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:54.476507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:54.477060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:54.477060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:54.478634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 666/1326] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:54.483918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938d25-1354-45c4-839a-751431476700 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:54.484373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938d25-1354-45c4-839a-751431476700 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:54.484467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37938d25-1354-45c4-839a-751431476700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:54.560729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-37938d25-1354-45c4-839a-751431476700 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:54.561939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-37938d25-1354-45c4-839a-751431476700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:54.666694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 661/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:54.950200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:54.951820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:55.012006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:55.057529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cfa17-edeb-400a-8999-6b7a0c733192 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:55.133300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:55.134795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:55.135085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:55.135360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:55.137032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:55.247347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:55.249963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:55.251635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b87a4-26c4-413f-98bc-d30c41479654 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:55.271703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 667/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:57:57.555348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:57.556129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:57.556129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:57.557373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 662/1329] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:57:57.562971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb0e-05d4-4ea6-b018-62fa820354d4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:57.563400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb0e-05d4-4ea6-b018-62fa820354d4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:57.563544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bcb0e-05d4-4ea6-b018-62fa820354d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:57.634574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e87bcb0e-05d4-4ea6-b018-62fa820354d4 None None] MFA Rules not processed for user `a2a1a361ba2441d093ccdff3013d4adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:57.635701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e87bcb0e-05d4-4ea6-b018-62fa820354d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:57.735497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 668/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:57:58.032529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:57:58.034149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:58.069272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:58.176503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bbd06-26bd-4052-816c-20f658126d18 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:57:58.264492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:57:58.265432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:58.265432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:58.265641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:58.267259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:58.353973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:57:58.390757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:57:58.392238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95421-9f7e-46cd-8dc2-c92125ed591f service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:57:58.414274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 663/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:00.886676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.887236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.887236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.888609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 669/1332] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:00.893832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266fb0-4bb5-4a38-ad43-675aed4ea900 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.894263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266fb0-4bb5-4a38-ad43-675aed4ea900 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.894372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266fb0-4bb5-4a38-ad43-675aed4ea900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.960892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-30266fb0-4bb5-4a38-ad43-675aed4ea900 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:00.962649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-30266fb0-4bb5-4a38-ad43-675aed4ea900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:01.057878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 664/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:01.344201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:01.345730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:01.416368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:01.451892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae0a47-abce-42e1-b24d-5bafff91830b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:01.525275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:01.525889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:01.526167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:01.526436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:01.528342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:01.636583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:01.638345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e89d34-09b3-491a-a132-6a3118ba9259 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:01.649797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:01.658961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 670/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:03.876529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.877073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.877073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.878413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 665/1335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:03.883657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9787b3-c347-4d7e-ad40-77eb31a79eda None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:03.884071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9787b3-c347-4d7e-ad40-77eb31a79eda None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:03.884236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9787b3-c347-4d7e-ad40-77eb31a79eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:03.950176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8c9787b3-c347-4d7e-ad40-77eb31a79eda None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:03.951486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8c9787b3-c347-4d7e-ad40-77eb31a79eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:04.049652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 671/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:58:04.340808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:04.342350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:04.386765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:04.450180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c946-4d65-49a3-bd1b-9e503976e547 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:04.523413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:04.524155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:04.524438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:04.524705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:04.526316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:04.610566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:04.646252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:04.647730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de06716-825f-4065-b13b-d8518ebfc089 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:04.666571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 666/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:07.237163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.237682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.237682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.238968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 672/1338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:07.244188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21013d-ad16-4527-bf61-d36854711439 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.244582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21013d-ad16-4527-bf61-d36854711439 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.244810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21013d-ad16-4527-bf61-d36854711439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.310512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ab21013d-ad16-4527-bf61-d36854711439 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:07.311738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ab21013d-ad16-4527-bf61-d36854711439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:07.410191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 667/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:07.689616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:07.691159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:07.772195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:07.800483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5ed9-efa5-459c-9ee5-ef4bc7fbcd02 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:07.879129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:07.879761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:07.880039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:07.880308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:07.881900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:07.991865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:07.993309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9e26-9817-4c10-9ee5-3bc939e7a287 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:08.012133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 673/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:12.219170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.219733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.219733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.221000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 668/1341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:12.226218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a13d0-a872-4171-a28c-717ce6b11a8a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.226617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a13d0-a872-4171-a28c-717ce6b11a8a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.226725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a13d0-a872-4171-a28c-717ce6b11a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.232467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.296878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-424a13d0-a872-4171-a28c-717ce6b11a8a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:12.298064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-424a13d0-a872-4171-a28c-717ce6b11a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:12.404218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 674/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:12.686357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:12.688021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:12.742477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.800037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9a85a-94ac-43b9-85e7-92f4f546b2b7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:12.878578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:12.879175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:12.879443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:12.879728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:12.881329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:12.978237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:12.995858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:12.997282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c20b8-1f77-4db8-ac65-fb560f87b3a4 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:13.016417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 669/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:15.780907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:15.781429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:15.781531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:15.782840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 675/1344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:15.788251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3bf59-08a0-4310-92a5-b3b9cd3fe72d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:15.788689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3bf59-08a0-4310-92a5-b3b9cd3fe72d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:15.788807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3bf59-08a0-4310-92a5-b3b9cd3fe72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:15.859944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0ed3bf59-08a0-4310-92a5-b3b9cd3fe72d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:15.861414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0ed3bf59-08a0-4310-92a5-b3b9cd3fe72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:15.970333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 670/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:16.262268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:16.263839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:16.360142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:16.377793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6b65e-3b99-473e-b8d1-9e82e30008e5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:16.457105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:16.457712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.457989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.458254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:16.459875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:16.574949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:16.576343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dcd84-7309-45d8-9b5c-563933965b2f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:16.595947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 676/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:20.893267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018450d-60c8-4810-b674-116d749882c1 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:20.893751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018450d-60c8-4810-b674-116d749882c1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:20.893930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018450d-60c8-4810-b674-116d749882c1 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:20.895436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 671/1347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:20.901659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cbafe-6efa-4abb-993f-a543c23445b5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:20.902162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cbafe-6efa-4abb-993f-a543c23445b5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:20.902162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cbafe-6efa-4abb-993f-a543c23445b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:20.918625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:20.982914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-cb9cbafe-6efa-4abb-993f-a543c23445b5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:20.984338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-cb9cbafe-6efa-4abb-993f-a543c23445b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.081119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 677/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:21.367290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018450d-60c8-4810-b674-116d749882c1 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.369438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1018450d-60c8-4810-b674-116d749882c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.427224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.474256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018450d-60c8-4810-b674-116d749882c1 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:21.550058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:21.550661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.550939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.551209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.552833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.659561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.663319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:21.665256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bcdc0-4f3e-434d-8b14-9a845f2d2bdc service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:21.683680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 672/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:26.768802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8773-e30b-4c76-a9c8-8911bd6965e2 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.769273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8773-e30b-4c76-a9c8-8911bd6965e2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.769600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8773-e30b-4c76-a9c8-8911bd6965e2 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.771310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 678/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:26.778017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b444e08-5a4a-4fbf-ab66-04e9bf001cf8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.778452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b444e08-5a4a-4fbf-ab66-04e9bf001cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.778754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b444e08-5a4a-4fbf-ab66-04e9bf001cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.888391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5b444e08-5a4a-4fbf-ab66-04e9bf001cf8 None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:26.889616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5b444e08-5a4a-4fbf-ab66-04e9bf001cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:27.034026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 673/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 12:58:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:58:31.079324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=59 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.299129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095a5b-af78-4843-a677-baca380fd1cf None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.299604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095a5b-af78-4843-a677-baca380fd1cf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.299998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095a5b-af78-4843-a677-baca380fd1cf None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.301473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 679/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 12:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:31.306953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13850-50a9-44ab-87a8-a5deb4b8cf4a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.307449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13850-50a9-44ab-87a8-a5deb4b8cf4a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.307851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13850-50a9-44ab-87a8-a5deb4b8cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.366386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.391622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-edc13850-50a9-44ab-87a8-a5deb4b8cf4a None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:31.393048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-edc13850-50a9-44ab-87a8-a5deb4b8cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:31.512535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 674/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:32.816797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ccad2-30b3-460e-ad2f-61dadfd2b564 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.817329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ccad2-30b3-460e-ad2f-61dadfd2b564 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.817329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ccad2-30b3-460e-ad2f-61dadfd2b564 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.818634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 680/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 12:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:32.824739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd47a6-ba6a-4684-82a5-3ff005963a4f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.825174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd47a6-ba6a-4684-82a5-3ff005963a4f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.825302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd47a6-ba6a-4684-82a5-3ff005963a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.905849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e2fd47a6-ba6a-4684-82a5-3ff005963a4f None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:32.907059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e2fd47a6-ba6a-4684-82a5-3ff005963a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:32.950055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:33.020056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 675/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:36.647309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb800-73cd-43c0-bab4-6af11b6d441f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.648184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb800-73cd-43c0-bab4-6af11b6d441f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.648587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb800-73cd-43c0-bab4-6af11b6d441f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.650953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 681/1356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:36.656766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97b3d-6d34-4cda-bc25-f365c0ea53ba None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.657221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97b3d-6d34-4cda-bc25-f365c0ea53ba None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.657316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97b3d-6d34-4cda-bc25-f365c0ea53ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.729389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f6e97b3d-6d34-4cda-bc25-f365c0ea53ba None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:36.730886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f6e97b3d-6d34-4cda-bc25-f365c0ea53ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:36.843997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 676/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:37.161106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.161576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.161996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.164039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 682/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Sep 7 12:58:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:37.171616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c155-ffe7-45eb-9d0f-6d1389b1ec98 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.172000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c155-ffe7-45eb-9d0f-6d1389b1ec98 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.172164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4c155-ffe7-45eb-9d0f-6d1389b1ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.189241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.260796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7ac4c155-ffe7-45eb-9d0f-6d1389b1ec98 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:37.262361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7ac4c155-ffe7-45eb-9d0f-6d1389b1ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:37.407602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 677/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Sep 7 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:37.417028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.418798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:37.588686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb6213-6571-48bd-835d-b4affafef441 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.673328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.721260 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.722166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.722540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.722913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.724976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:37.827090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:37.828732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ffefb-92a8-47b2-b9a9-b6ae8655c993 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:37.849472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 683/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 12:58:40.271792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.271792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.271792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.272555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 678/1361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:40.278589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586cc3-c1b9-4836-82ba-6bfd88d51c51 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.279036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586cc3-c1b9-4836-82ba-6bfd88d51c51 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.279135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43586cc3-c1b9-4836-82ba-6bfd88d51c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.355305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-43586cc3-c1b9-4836-82ba-6bfd88d51c51 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:40.356799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-43586cc3-c1b9-4836-82ba-6bfd88d51c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:40.397183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:40.466886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 684/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:40.756416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:40.758266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:40.852193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:40.976070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87f4ad-4812-4353-a9f4-9159e920aef5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.105955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.106708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.106985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.107254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.108958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:41.134858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.209728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.211401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5e74a-b2eb-485e-9f09-a96080ea25d4 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.230817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 679/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:43.746167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157d0e-3090-420c-99a6-c1e84b77dbaf None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.746741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157d0e-3090-420c-99a6-c1e84b77dbaf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.746741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157d0e-3090-420c-99a6-c1e84b77dbaf None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.751505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 685/1364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:43.753430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcc60-e82f-40fb-b648-11c2f1bd4cc3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.753839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcc60-e82f-40fb-b648-11c2f1bd4cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.754151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fcc60-e82f-40fb-b648-11c2f1bd4cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.826711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-677fcc60-e82f-40fb-b648-11c2f1bd4cc3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:43.827997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-677fcc60-e82f-40fb-b648-11c2f1bd4cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:43.931511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:43.935663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 680/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:44.239725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.240190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.240540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.242255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 686/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Sep 7 12:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:44.248225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105da3-06dc-4af8-adb4-412817fe9fe7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.248621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105da3-06dc-4af8-adb4-412817fe9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.248990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105da3-06dc-4af8-adb4-412817fe9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.330130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-03105da3-06dc-4af8-adb4-412817fe9fe7 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:44.331340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-03105da3-06dc-4af8-adb4-412817fe9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:44.471120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 681/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Sep 7 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:44.479820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:44.481781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:44.655291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68e390-2825-4ab4-a43a-3a1ead68010f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:44.676474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:44.783167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:44.784136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.784616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.785074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.788098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:44.899341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:44.902141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb80a-63bd-45c3-be8f-622f91139d1d service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:44.922439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 687/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 12:58:44.948536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f289e-cf44-4602-8769-24617a6077e5 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.949057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f289e-cf44-4602-8769-24617a6077e5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.949057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f289e-cf44-4602-8769-24617a6077e5 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.950591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 682/1369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:44.956769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea96f6-283b-4eca-8ce8-b093f00626a6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.957205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea96f6-283b-4eca-8ce8-b093f00626a6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.957533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea96f6-283b-4eca-8ce8-b093f00626a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.992923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.036455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-80ea96f6-283b-4eca-8ce8-b093f00626a6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:45.037678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-80ea96f6-283b-4eca-8ce8-b093f00626a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:45.168305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 688/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:45.477324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.477730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.478151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.479938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 683/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Sep 7 12:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:45.485441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9922e1-fbd7-45e3-9630-6d90fd0a76d0 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.485731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9922e1-fbd7-45e3-9630-6d90fd0a76d0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.486004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9922e1-fbd7-45e3-9630-6d90fd0a76d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.574052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6e9922e1-fbd7-45e3-9630-6d90fd0a76d0 None None] MFA Rules not processed for user `8c44a2759eab46dbae21ad7eeb96df9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:45.575400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6e9922e1-fbd7-45e3-9630-6d90fd0a76d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:45.629797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.664571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 689/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Sep 7 12:58:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:45.672050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.673552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:45.730029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.791614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32b3a9-7bc6-4dd5-bc94-54aba2cd91b2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.881732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.882337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.882675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.883092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.885793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:46.004996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:46.022698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.024214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a96a04-ec99-4ac4-bf76-dda429885f5f service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.047588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 684/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:47.214640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.215221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.215318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.216742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 690/1374] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:47.222001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c31d2-6f6e-429e-bab6-207a5f48928c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.222412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c31d2-6f6e-429e-bab6-207a5f48928c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.222551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c31d2-6f6e-429e-bab6-207a5f48928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.289722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bf7c31d2-6f6e-429e-bab6-207a5f48928c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:47.291612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bf7c31d2-6f6e-429e-bab6-207a5f48928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:47.410502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 685/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:47.711499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:47.713966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:47.867287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841d4a5-7587-4a01-bbbb-a94f2b9114c3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.922423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:47.988552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.989281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.989394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.989668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.991262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:48.094204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.095493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588d79b-78b4-4925-b570-bd29251b67d0 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:48.119635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 691/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:50.565238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.565803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.565803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.567297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 686/1377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:50.573469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a63-c5fb-4d66-b616-cd5b4d008323 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.573930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a63-c5fb-4d66-b616-cd5b4d008323 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.574058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd959a63-c5fb-4d66-b616-cd5b4d008323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.652081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-dd959a63-c5fb-4d66-b616-cd5b4d008323 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:50.653294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dd959a63-c5fb-4d66-b616-cd5b4d008323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:50.660661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.758379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 692/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:51.061687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.063177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:51.127910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.237875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ac388-16be-41be-b99f-cc9ece693908 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.364520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.365124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.365398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.365665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.367227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:51.387960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.472926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:51.475658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa2f5c-7f27-4949-aa5e-a509df5dc753 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:51.499435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 687/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:53.786405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.786959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.786959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.788610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 693/1380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:53.794671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f447c-72d5-4aad-8e22-1bb9bdc38aa4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.795167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f447c-72d5-4aad-8e22-1bb9bdc38aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.795167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f447c-72d5-4aad-8e22-1bb9bdc38aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.885223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-157f447c-72d5-4aad-8e22-1bb9bdc38aa4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:53.886450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-157f447c-72d5-4aad-8e22-1bb9bdc38aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:53.982911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:53.989713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 688/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:54.361722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.363496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:54.512154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.523838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8ea12-6f5a-4bad-940d-0f9e682b7e57 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.648551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.649730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.650068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.650402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.652472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:54.770765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.773086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88802955-b57a-45fd-b297-ae69b1a5445e service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.786056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.794998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 694/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:58:57.244899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.245436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.245557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.247287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 689/1383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:57.252821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363800e-0a17-48ff-a0e5-e40530f4290b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.253235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363800e-0a17-48ff-a0e5-e40530f4290b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.253390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363800e-0a17-48ff-a0e5-e40530f4290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.327735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6363800e-0a17-48ff-a0e5-e40530f4290b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:57.329501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6363800e-0a17-48ff-a0e5-e40530f4290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:57.436328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 695/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:58:57.810324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.811848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:57.983801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13194b-01d6-4c46-8ea3-26fa6bdc6bd3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:58.059422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:58.119676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:58.120478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:58.120812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:58.121148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:58.123172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:58.222722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:58.224423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1b29e-8a98-4ad1-bd9d-6c13529c1097 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:58.248545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 690/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:00.543557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.544156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.544156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.545435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 696/1386] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:00.550593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187debd-21e1-40f3-9178-f02a3ca61307 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.551009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187debd-21e1-40f3-9178-f02a3ca61307 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.551139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187debd-21e1-40f3-9178-f02a3ca61307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.619251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6187debd-21e1-40f3-9178-f02a3ca61307 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:00.620480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6187debd-21e1-40f3-9178-f02a3ca61307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:00.655093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:00.725228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 691/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:01.015779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.017289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:01.100279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.170855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ab372-35e0-4b00-8b2c-088dcad88f26 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.286630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.287146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.287425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.287723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.289309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:01.330809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.387831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.389459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea7b00-92b7-4f5e-904a-aeeeb61f4c4d service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.409328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 697/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:01.628296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfcbf-1d47-4071-b4a5-b0b7f2e98814 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.628884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfcbf-1d47-4071-b4a5-b0b7f2e98814 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.628884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccfcbf-1d47-4071-b4a5-b0b7f2e98814 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.630182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 692/1389] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:01.636786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff940-297b-494d-925e-e6d72565f885 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.637339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff940-297b-494d-925e-e6d72565f885 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.637339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff940-297b-494d-925e-e6d72565f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.710841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-441ff940-297b-494d-925e-e6d72565f885 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:01.712298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-441ff940-297b-494d-925e-e6d72565f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:01.811227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 698/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:02.110833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.111133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.111397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.113049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 693/1391] 10.222.0.18 () {54 vars in 961 bytes} [Wed Sep 7 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:02.118259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5c8-bf4c-4d19-9f4b-10e09eb3a533 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.118539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5c8-bf4c-4d19-9f4b-10e09eb3a533 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.118839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5c8-bf4c-4d19-9f4b-10e09eb3a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.134946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.199043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6b7df5c8-bf4c-4d19-9f4b-10e09eb3a533 None None] MFA Rules not processed for user `1a27293dafee4bf88135e986f6a73fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:02.200311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6b7df5c8-bf4c-4d19-9f4b-10e09eb3a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:02.278320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 699/1392] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Sep 7 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:02.287574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.289113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:02.397784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6a8e-ad40-413a-ae45-27e379fbd42c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.457049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.474264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.474878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.475160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.475430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.477089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:02.598597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:02.600058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a81a71-d89a-4f0c-91c8-4ae2ccf910d5 service glance] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:02.620365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 694/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:03.373687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b23-e7dc-47ba-ad2b-67919612b956 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.374251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b23-e7dc-47ba-ad2b-67919612b956 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.374251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b23-e7dc-47ba-ad2b-67919612b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.448507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6a130b23-e7dc-47ba-ad2b-67919612b956 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:03.449753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6a130b23-e7dc-47ba-ad2b-67919612b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:03.505057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.542098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 700/1394] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:03.589408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a7f61-0297-4cd8-85cd-1acef1a400a9 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.590172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a7f61-0297-4cd8-85cd-1acef1a400a9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.590172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a7f61-0297-4cd8-85cd-1acef1a400a9 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.591423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 695/1395] 10.222.0.18 () {54 vars in 943 bytes} [Wed Sep 7 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:03.598543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.598899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.599240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.678974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] MFA Rules not processed for user `1192aab6e0444db1b006feb37c0fd3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:03.680126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:03.688817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d0e0-b4b6-4f19-98ff-4ff1d3699203 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.689097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d0e0-b4b6-4f19-98ff-4ff1d3699203 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.689374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d0e0-b4b6-4f19-98ff-4ff1d3699203 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.690714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 696/1396] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:03.695661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.696583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.696887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.765969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:03.767232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:03.793509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 701/1397] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Sep 7 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:03.803398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.812645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.814170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9955e3-3967-48c5-8aa4-f9159e99b112 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.840300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.872658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 697/1398] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:03.924259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.924857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.925130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.925395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.927039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:04.016145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.017656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ee3a5-681c-4cd5-859e-c779483a8e54 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.026184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 702/1399] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 12:59:04.168284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.169492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:04.297327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a3c3-3b12-49f8-af13-85a0f09f45b9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.362194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.433827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49171abe-9122-439a-a861-b9615126c351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.434869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171abe-9122-439a-a861-b9615126c351 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.435243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171abe-9122-439a-a861-b9615126c351 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.435670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49171abe-9122-439a-a861-b9615126c351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.437610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-49171abe-9122-439a-a861-b9615126c351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:04.547492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49171abe-9122-439a-a861-b9615126c351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.549035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49171abe-9122-439a-a861-b9615126c351 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.571436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 698/1400] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:06.845805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.846333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.846333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.848091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 703/1401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:06.854192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd655-4683-4d06-98a0-30513c33bc84 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.854668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd655-4683-4d06-98a0-30513c33bc84 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.854775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cd655-4683-4d06-98a0-30513c33bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.932363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-073cd655-4683-4d06-98a0-30513c33bc84 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:06.933585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-073cd655-4683-4d06-98a0-30513c33bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:06.948783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.060374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 699/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:07.357184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.359026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:07.447037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.558116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9dec-e569-467b-aa24-60a2d4f55f31 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.690707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.691602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.691887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.692156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.693745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:07.715228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.798395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:07.800157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee48a06-c9ab-4012-8b80-8fa83f3ca7a6 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:07.827897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 704/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:10.159453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.160036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.160036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.161363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 700/1404] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:10.166867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e887fb-a1e4-4fe5-8387-6d9f82e6ed67 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.167370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e887fb-a1e4-4fe5-8387-6d9f82e6ed67 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.167486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e887fb-a1e4-4fe5-8387-6d9f82e6ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.241982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e3e887fb-a1e4-4fe5-8387-6d9f82e6ed67 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:10.243439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e3e887fb-a1e4-4fe5-8387-6d9f82e6ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:10.348244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.357106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 705/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:10.655694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.657519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:10.821380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.824774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c42c4-6cc7-4505-b3bf-4dfd75a448ca None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.956641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.957476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.957753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.958022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.959695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:11.061952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:11.064766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e11493-1b6b-46cc-b9a6-1faaf1bcab34 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:11.085186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 701/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:13.353630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321029b2-a932-4640-88e0-6f257133115a None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.354182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321029b2-a932-4640-88e0-6f257133115a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.354182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321029b2-a932-4640-88e0-6f257133115a None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.355544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 706/1407] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 12:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:13.361004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446a46-d1a9-46cc-beb5-35927c52fed6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.361448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446a46-d1a9-46cc-beb5-35927c52fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.362257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10446a46-d1a9-46cc-beb5-35927c52fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.366961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.437190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-10446a46-d1a9-46cc-beb5-35927c52fed6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:13.438799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-10446a46-d1a9-46cc-beb5-35927c52fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:13.559258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 702/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:13.861339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321029b2-a932-4640-88e0-6f257133115a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.862924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-321029b2-a932-4640-88e0-6f257133115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:14.032421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321029b2-a932-4640-88e0-6f257133115a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.108568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.169760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.170398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.170675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.171069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.172759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:14.270289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.271921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f82718-1bd4-40f3-95c2-e7fa704d4e1e service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.294652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 707/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:23.557181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=64 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.292022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=64 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.797860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696dbb5-fadd-45fb-84ad-ebe24201e93f None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.798382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696dbb5-fadd-45fb-84ad-ebe24201e93f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.798382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696dbb5-fadd-45fb-84ad-ebe24201e93f None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.799721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 703/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Sep 7 12:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:26.804878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5883a12-bd5c-4a96-9751-985eb1fdc85e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.805322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5883a12-bd5c-4a96-9751-985eb1fdc85e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.805433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5883a12-bd5c-4a96-9751-985eb1fdc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.881268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e5883a12-bd5c-4a96-9751-985eb1fdc85e None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:26.882479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e5883a12-bd5c-4a96-9751-985eb1fdc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:27.104885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 708/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Sep 7 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:27.119590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6b82-254f-4b32-a29b-dd67e16f8106 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.119875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6b82-254f-4b32-a29b-dd67e16f8106 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.120141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e6b82-254f-4b32-a29b-dd67e16f8106 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.121474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 704/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Sep 7 12:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:27.126566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57504d-e8d7-4c99-bd2f-f62c31af29d6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.126851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57504d-e8d7-4c99-bd2f-f62c31af29d6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.127126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57504d-e8d7-4c99-bd2f-f62c31af29d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.201886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.204473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fa57504d-e8d7-4c99-bd2f-f62c31af29d6 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:27.206279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fa57504d-e8d7-4c99-bd2f-f62c31af29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:27.324384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 709/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Sep 7 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:30.006143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.006745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.006745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.008359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:30.018832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5b8e-6b91-42c5-ba32-d9cfbde14456 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.019367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5b8e-6b91-42c5-ba32-d9cfbde14456 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.019500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5b8e-6b91-42c5-ba32-d9cfbde14456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.092854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-532e5b8e-6b91-42c5-ba32-d9cfbde14456 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:30.094060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-532e5b8e-6b91-42c5-ba32-d9cfbde14456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.149304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.190304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:30.479786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.481416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.635351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8517332-7805-4f9a-a269-49be1a52103b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.709616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.750822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.751357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.751670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.751944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.753548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.843585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.845192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09813ea5-865e-46e3-be1c-8ad129649e5c service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.863234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 706/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:32.044185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.044903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.044903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.047281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:32.054203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f16-f48c-4160-9ae6-e72ac18e8f48 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.055606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f16-f48c-4160-9ae6-e72ac18e8f48 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.055606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f16-f48c-4160-9ae6-e72ac18e8f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.131766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9c688f16-f48c-4160-9ae6-e72ac18e8f48 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:32.133008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9c688f16-f48c-4160-9ae6-e72ac18e8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:32.163779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.237068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:32.391122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.392710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:32.543761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff49cd-96ee-47a3-91ed-5c51c7cabf42 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.586822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.661018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.661534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.661808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.662074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.663801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:32.751854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.753436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb536c-4d0f-4481-82fc-bc2920415c36 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.771662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 712/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:33.925906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.926447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.926447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.927831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:33.934481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d5e-5812-47a3-a7f7-8add020dcb65 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.934957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d5e-5812-47a3-a7f7-8add020dcb65 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.935063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423d5e-5812-47a3-a7f7-8add020dcb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.988916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.011373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4c423d5e-5812-47a3-a7f7-8add020dcb65 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:34.012699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4c423d5e-5812-47a3-a7f7-8add020dcb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:34.111562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:34.261217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.262703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:34.409047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf6d3d-bf52-4eea-bb8c-4a8b62d92933 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.421501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.522572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.522572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.522792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.523015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.527452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:34.618814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.620403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8179c8e-b531-474b-99b3-fd724db86310 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.641847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 709/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:35.759051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.759546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.759668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.760971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:35.767441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8222-e152-4939-a4fe-7f184c439985 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.768009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8222-e152-4939-a4fe-7f184c439985 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.768009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae8222-e152-4939-a4fe-7f184c439985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.787652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:35.847144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-27ae8222-e152-4939-a4fe-7f184c439985 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:35.848719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-27ae8222-e152-4939-a4fe-7f184c439985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:35.944606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:36.096278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.097758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:36.212022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.248848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab73b94-cb1c-42f5-94f2-af132bf9659b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.362105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.362705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.362981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.363248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.364885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:36.441056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.454494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.456145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107399c4-4c44-4d93-9148-e1e6b19b9240 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.474727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 715/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:37.594796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.595351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.595351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.596785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:37.603790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45285a11-88f0-4433-8cbf-13f1fe6bdc04 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.604232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45285a11-88f0-4433-8cbf-13f1fe6bdc04 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.604343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45285a11-88f0-4433-8cbf-13f1fe6bdc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.678676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-45285a11-88f0-4433-8cbf-13f1fe6bdc04 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:37.680864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-45285a11-88f0-4433-8cbf-13f1fe6bdc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:37.785774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:37.938494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.940032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:38.024392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.097963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b9f33-8d52-4308-a1e0-410d195f5fc2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.212473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.213075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.213351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.213621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.215221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:38.263376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.308441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.310434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1de9-1b04-410a-9bc6-e8a3320a68ae service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.329420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 712/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:39.422429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.423089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.423089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.424343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:39.431789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88526161-8338-40f9-955b-e0844e3fc35e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.432336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88526161-8338-40f9-955b-e0844e3fc35e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.432336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88526161-8338-40f9-955b-e0844e3fc35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.511411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-88526161-8338-40f9-955b-e0844e3fc35e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:39.512636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-88526161-8338-40f9-955b-e0844e3fc35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:39.610458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:39.758663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.760197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:39.812579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.915304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946450d-40e6-47fc-be44-a40ac7883e79 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.028938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.029451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.029724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.029991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.031605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:40.038422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.121907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.123521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7b3db-c8d1-4719-af2d-49bb6a8a8c82 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.142256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 718/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:41.207802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.208349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.208349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.209699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:41.216684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9c7c-78ca-4fee-9251-38796845347d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.217172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9c7c-78ca-4fee-9251-38796845347d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.217275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d9c7c-78ca-4fee-9251-38796845347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.293603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-cc3d9c7c-78ca-4fee-9251-38796845347d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:41.294843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-cc3d9c7c-78ca-4fee-9251-38796845347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:41.362147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.392254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:41.548553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.550089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:41.568199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.697518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc6e6a-126c-4244-b567-f7e2bbfff2fd None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.784474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.812729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.813331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.813606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.813874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.815482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:41.908793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.910387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586438-22cb-47c9-8ada-043807af4fd2 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.929044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 715/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 12:59:42.993394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.993958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.993958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.995270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:43.001715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece452-e758-4a49-a58b-821d189959d7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.002206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece452-e758-4a49-a58b-821d189959d7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.002315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ece452-e758-4a49-a58b-821d189959d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.081542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-53ece452-e758-4a49-a58b-821d189959d7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:43.082669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-53ece452-e758-4a49-a58b-821d189959d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:43.125377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.192336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:43.344283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.345759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:43.496357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c0aee-e2fa-4924-babd-90398d94d1de None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.551165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.615578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.616182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.616458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.616750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.618347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:43.706243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.707875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb906d0d-6cf8-465f-9fa9-bacaadab9c66 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.725854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 721/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:44.788427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.789496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.789611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.790929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 12:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:44.797457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bf4-a941-4c61-af07-5097eb59968a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.797940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bf4-a941-4c61-af07-5097eb59968a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.798050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f0bf4-a941-4c61-af07-5097eb59968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.876421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4d6f0bf4-a941-4c61-af07-5097eb59968a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:44.877622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4d6f0bf4-a941-4c61-af07-5097eb59968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:44.879687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.976988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:45.139503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.141053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:45.290464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0645c-d0bd-4265-bf3c-41d7f357dc60 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.317445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.405620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.406141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.406418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.406687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.408428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:45.509439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.511026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34e0d5-bc45-4a99-ac07-85ad08406acd service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.531814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 718/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:47.609820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.610376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.610376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.611769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 12:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:47.617563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da99fe-5871-4945-bfb4-dc87b469dfd4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.618007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da99fe-5871-4945-bfb4-dc87b469dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.618118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da99fe-5871-4945-bfb4-dc87b469dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.658614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:47.687169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-78da99fe-5871-4945-bfb4-dc87b469dfd4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:47.688423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-78da99fe-5871-4945-bfb4-dc87b469dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.786890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:48.068764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:48.071318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:48.175682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b91f2-2bba-4c04-9fcf-1c80a02ab465 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:48.208952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:48.250895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:48.251524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.251805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.252075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.253658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:48.361804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:48.363236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477462ac-f094-42d2-9e01-d7e3661aedee service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:48.382439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 724/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:50.799341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.799924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.799924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.801180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 12:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:50.807329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6404-8a0c-4f09-9b1e-bedead13b37f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.807907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6404-8a0c-4f09-9b1e-bedead13b37f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.807907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa6404-8a0c-4f09-9b1e-bedead13b37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.884610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4cfa6404-8a0c-4f09-9b1e-bedead13b37f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:50.885857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4cfa6404-8a0c-4f09-9b1e-bedead13b37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:50.902112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.011891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:51.300720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.302257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:51.406995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5f7b4-8d0e-484a-a5ec-f0c2944c2774 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.419639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.482546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.483143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.483417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.483707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.485323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:51.595793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.597164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae00e9-5725-4d96-a39a-efe9a8c57fd7 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.614845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 721/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:54.113303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.113885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.113885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.115232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 12:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:54.121213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08878-99cb-453d-870e-f61fe7a6983a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.121603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08878-99cb-453d-870e-f61fe7a6983a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.121827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08878-99cb-453d-870e-f61fe7a6983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.169573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.188640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d4e08878-99cb-453d-870e-f61fe7a6983a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:54.189842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d4e08878-99cb-453d-870e-f61fe7a6983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:54.289815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 12:59:54.586618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.587916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:54.693669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437744c-a358-459f-b54e-457d07d3e51b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.733611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.766108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.766698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.766969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.767231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.768841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:54.884037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:54.885556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4fc23-1c36-4227-a541-10e6f7ebda4f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:54.904522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 727/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 12:59:57.205352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.205950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.205950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.207228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:57.213367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6ab7-d783-4c7b-9c6c-68da39a417f2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.213805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6ab7-d783-4c7b-9c6c-68da39a417f2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.213915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c6ab7-d783-4c7b-9c6c-68da39a417f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.291691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-534c6ab7-d783-4c7b-9c6c-68da39a417f2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:57.292909 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-534c6ab7-d783-4c7b-9c6c-68da39a417f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:57.315433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.392431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 12:59:57.686069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.687696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:57.790668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8afc59-d08c-4839-894c-9579c1b03ab7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.810912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.866863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.867513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.867770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.868043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.869636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:57.980846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.982330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeb826-377d-4f56-b063-b82de15a03ad service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.000239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 724/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:00.240522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.241079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.241079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.243098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:00.248470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa1f5-7893-4a56-887e-7ed821c94123 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.248897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa1f5-7893-4a56-887e-7ed821c94123 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.249046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aa1f5-7893-4a56-887e-7ed821c94123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.313085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.316205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5e1aa1f5-7893-4a56-887e-7ed821c94123 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:00.318021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5e1aa1f5-7893-4a56-887e-7ed821c94123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:00.415169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:00.704244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.705829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:00.811231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce8be0-b7fc-42e7-abc4-dfd176c48dfd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.859906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.887136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.887905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.887905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.888109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.889655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:01.016131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.017470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1843e-2cc5-49be-a461-4a6f23eef12a service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.035402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 730/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:03.344053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.344631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.344631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.345942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:03.352209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3f8b-47c7-48a2-9fd9-4943eed323bb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.352633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3f8b-47c7-48a2-9fd9-4943eed323bb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.352794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3f8b-47c7-48a2-9fd9-4943eed323bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.422395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-392e3f8b-47c7-48a2-9fd9-4943eed323bb None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:03.423665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-392e3f8b-47c7-48a2-9fd9-4943eed323bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:03.456633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.528187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:03.821507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.823031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:03.929087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c9e56-efcd-4618-ad15-8a72a3078455 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.957143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.002997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.003611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.003884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.004150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.005732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:04.114421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.115867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a877-127f-4e87-8b8b-3d3cab77f54c service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.134293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 727/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:06.361827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.362380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.362380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.363734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:06.369684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba10f-e2c5-4d12-830b-55adaa2db3ea None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.370169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba10f-e2c5-4d12-830b-55adaa2db3ea None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.370285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbba10f-e2c5-4d12-830b-55adaa2db3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.437430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0fbba10f-e2c5-4d12-830b-55adaa2db3ea None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:06.438594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0fbba10f-e2c5-4d12-830b-55adaa2db3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:06.447016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:06.540126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:06.823932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:06.825461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:06.933791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9110629-1f1a-43a7-9891-18ad38f5bfbc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:06.991870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:07.010156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:07.010754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.011028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.011295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.012913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.129352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:07.130824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c06583-f1e9-4e07-86d0-1f258d747ffa service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:07.150762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 733/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:09.403584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.404159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.404159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.405472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:09.410883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cb9e-76f1-4734-b49a-f6a34a98b554 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.411295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cb9e-76f1-4734-b49a-f6a34a98b554 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.411454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cb9e-76f1-4734-b49a-f6a34a98b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.479742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6836cb9e-76f1-4734-b49a-f6a34a98b554 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:09.481054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6836cb9e-76f1-4734-b49a-f6a34a98b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:09.519215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.578725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:09.870073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.871655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:09.974792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed626d-44fb-4b55-a6d6-e23fb1749de3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.012782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.049901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.050499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.050777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.051044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.052676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:10.168871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.170300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b868e2-a56a-43a1-8b77-8e76adba26be service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.188521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 730/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:12.374036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.374607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.374607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.376054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:12.382284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbcd25-9e42-45e3-802f-f183f2a42242 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.382856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbcd25-9e42-45e3-802f-f183f2a42242 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.382954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbcd25-9e42-45e3-802f-f183f2a42242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.448706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-86fbcd25-9e42-45e3-802f-f183f2a42242 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:12.449849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-86fbcd25-9e42-45e3-802f-f183f2a42242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:12.468810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.561238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:12.844361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.845935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:12.959194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db71b4-89ea-46e9-8678-f6ee31c9dbdf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.027320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.034360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.034961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.035239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.035546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.037187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:13.150487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.151954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeafdfd-5379-41d9-a4ce-d69f139b8c1d service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.170390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 736/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:15.427939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.429102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.429102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.430465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:15.436231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb89a-91c2-4378-9228-14f1874005aa None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.436679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb89a-91c2-4378-9228-14f1874005aa None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.436822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb89a-91c2-4378-9228-14f1874005aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.503507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f70cb89a-91c2-4378-9228-14f1874005aa None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:15.504720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f70cb89a-91c2-4378-9228-14f1874005aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:15.554741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.603830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:15.898501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.900090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.008151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac31780-9528-4bf8-a2ba-59b850518b21 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.056781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.083307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.083939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.084217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.084491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.087055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.216485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.217921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e0e15-9793-4a1f-bf56-26d0bc2c86b4 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.355354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 733/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:25.602049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=22 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:26.352838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=66 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.490937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103190e-3188-4217-81c3-242bd34b6d62 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.491673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103190e-3188-4217-81c3-242bd34b6d62 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.491673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103190e-3188-4217-81c3-242bd34b6d62 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.493565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 738/1471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:36.499149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf890-58f7-49cc-80da-82475afef6de None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.499650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf890-58f7-49cc-80da-82475afef6de None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.499769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf890-58f7-49cc-80da-82475afef6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.568215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-945bf890-58f7-49cc-80da-82475afef6de None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:36.569950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-945bf890-58f7-49cc-80da-82475afef6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:36.664875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 734/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:36.967266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.967572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.967845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.969184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 739/1473] 10.222.0.18 () {54 vars in 961 bytes} [Wed Sep 7 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:36.974330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6040e-ff3b-4458-9122-04fe0b4ee27c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.974613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6040e-ff3b-4458-9122-04fe0b4ee27c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.974935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6040e-ff3b-4458-9122-04fe0b4ee27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.051532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e3d6040e-ff3b-4458-9122-04fe0b4ee27c None None] MFA Rules not processed for user `1a27293dafee4bf88135e986f6a73fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:37.052746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e3d6040e-ff3b-4458-9122-04fe0b4ee27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:37.074997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.130503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 735/1474] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Sep 7 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:37.138248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.139923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:37.244120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf55de-daaf-4eff-9a22-9c3f2c6fc99f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.318310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.318959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.319235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.319538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.321136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:37.376785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.432449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.434159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474b77e-1eae-4c9c-8b1e-ea2e477ebe93 service glance] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.452697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 740/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:39.728818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.729379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.729379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.730718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 736/1476] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:39.735959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d56e-cd2a-4627-817a-af06d2e238cc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.736389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d56e-cd2a-4627-817a-af06d2e238cc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.736519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44d56e-cd2a-4627-817a-af06d2e238cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.802075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7d44d56e-cd2a-4627-817a-af06d2e238cc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:39.803842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7d44d56e-cd2a-4627-817a-af06d2e238cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:39.901892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 741/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:40.180856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.182429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:40.309790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e4b91-a682-47fc-9eaa-3d842859a8c2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.361063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.409037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.409635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.409908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.410169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.410840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.412661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:00:40.412661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:00:40.412661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:00:40.413774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e061b-f25f-4e71-aea5-e2834ed72a15 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.432369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 737/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:00:42.634049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:42.634623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:42.634623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:42.635987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 742/1479] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:42.641345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ceed-8caf-4339-82e9-dae1cf117432 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:42.641776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ceed-8caf-4339-82e9-dae1cf117432 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:42.641883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7ceed-8caf-4339-82e9-dae1cf117432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:42.708494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0ee7ceed-8caf-4339-82e9-dae1cf117432 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:42.710538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0ee7ceed-8caf-4339-82e9-dae1cf117432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:42.808794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 738/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:43.097549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:43.099066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:43.109027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:43.244172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901e9de-bb8a-49b9-85ab-03e2de761d94 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:43.325905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:43.360853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:43.361391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:43.361670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:43.361941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:43.363577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:43.456770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:43.458357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb5eb3-0c10-4833-91ad-7abf57dd0295 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:43.493502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 743/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:45.893803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.894383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.894383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.895715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 739/1482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:45.901850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60de7d-9352-4658-b5bf-f363d3896e4c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:45.902271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60de7d-9352-4658-b5bf-f363d3896e4c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:45.902397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60de7d-9352-4658-b5bf-f363d3896e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:45.968962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2e60de7d-9352-4658-b5bf-f363d3896e4c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:45.970174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2e60de7d-9352-4658-b5bf-f363d3896e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.016507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.067642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 744/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:46.359203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:46.360832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.384623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.465355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17429f-f41b-4ed0-9c3c-e796eac926e2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:46.542358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:46.542947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.543221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.543516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.545103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.620887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:46.656263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:46.657687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd6d6e3-5185-4afd-aaae-00b5980a96f2 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:46.676169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 740/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:48.892197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:48.892759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:48.892759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:48.894077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 745/1485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:48.899918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c023c9-02db-4c13-b52d-5964bf6d09e0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:48.900328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c023c9-02db-4c13-b52d-5964bf6d09e0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:48.900465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c023c9-02db-4c13-b52d-5964bf6d09e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:48.968159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c5c023c9-02db-4c13-b52d-5964bf6d09e0 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:48.969378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c5c023c9-02db-4c13-b52d-5964bf6d09e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.070186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 741/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:49.388513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:49.389826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.503079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc10ee-bf0e-4e17-a5b2-9d409d84d1ba None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:49.575042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:49.576892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:49.577507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:49.577995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:49.578525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:49.580374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.691016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:49.692405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a8dfb-a201-4968-95c0-341c9c5f5a5c service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:49.712228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 746/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:52.027450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:52.028096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:52.028096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:52.029367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 742/1488] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:52.034612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bd37-f40a-4025-808e-c810e378b9e9 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:52.035069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bd37-f40a-4025-808e-c810e378b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:52.035165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bd37-f40a-4025-808e-c810e378b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:52.102920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9024bd37-f40a-4025-808e-c810e378b9e9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:52.104160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9024bd37-f40a-4025-808e-c810e378b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:52.156439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:52.209713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 747/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:52.540365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:52.541919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:52.585131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:52.667237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613210e5-56ec-4967-9848-e8f895d93356 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:52.749939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:52.751388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:52.751702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:52.751979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:52.753618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:52.863587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:52.897273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:52.898689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a955677-404f-4b9b-b591-f972fcfa3551 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:52.921085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 743/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:00:55.385069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:55.385636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:55.385636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:55.386950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 748/1491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Sep 7 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:55.392319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ad54-8227-4ba4-b006-f568345963be None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:55.392722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ad54-8227-4ba4-b006-f568345963be None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:55.392861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75ad54-8227-4ba4-b006-f568345963be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:55.463518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ef75ad54-8227-4ba4-b006-f568345963be None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:55.464733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ef75ad54-8227-4ba4-b006-f568345963be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:55.573394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 744/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:00:55.868784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:55.870352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:55.977327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578a278-8bb9-4073-bad4-351d3ee9ca43 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:56.054854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:56.055549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:56.055776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:56.056038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:56.057620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:56.066835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:56.165498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:56.166847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15378c73-cdb0-46cc-8267-cd4e81c01e55 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:56.185300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 749/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:01:05.571549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=82 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:06.182718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=50 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:09.615775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:09.616340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:09.616340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:09.691432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:09.693215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.788574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 745/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:09.796400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:09.796878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:09.797013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:09.875666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:09.876873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.976316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 750/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:09.981027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:09.982233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:09.994410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57194c-405c-4329-91f3-2287fc24b685 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.055747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:10.091129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.091752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.092022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.092320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.092945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:10.093237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.094220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.094220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:02:10.094220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:02:10.095086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.106112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 746/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:10.114503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:10.123711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f91bd-11a3-4208-92e7-983bb373b851 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.189351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:10.223970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.224581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.224859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.225128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.225759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.227508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.227508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:02:10.227508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:02:10.228718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.284685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 751/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:02:10 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:02:10.289470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:10.290990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:10.334050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ad95c-7057-4b69-9bff-99df0b05adaa admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.427625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.428219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.428488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.428747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.429367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.430358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.430358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:02:10.430358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:02:10.431568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.473649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 747/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:02:10 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:02:10.478193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:10.479741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:10.542573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba1a3-6086-43bf-9764-c4f052024fc5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.628822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:10.641197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.641794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.642176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.642542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.643180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.644248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.644248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:02:10.644248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:02:10.645831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.658153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 752/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:02:10.662797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:10.664487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:10.676547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bfeab-68c4-4273-96d2-3b783c61872d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.701581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:10.774061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.774666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.774940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.775208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.775889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.776882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.776882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:02:10.776882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:02:10.777767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f366711-3a3f-4a4f-8838-70461b2abfec admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.791071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 748/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:02:10.795176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:10.796729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:10.830505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826054-99cd-481e-84d7-1921a9046778 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:10.926759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:10.927399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.927777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.928049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] PATH_INFO: `/v3/projects/3434b4062a0944d0a286fe5636673d12/users/4965911ab18341c1966f4d2dca78bed2/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:10.951410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3434b4062a0944d0a286fe5636673d12, user_id=4965911ab18341c1966f4d2dca78bed2, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:10.952470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:10.952470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:02:10.952470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:02:10.954375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc642f5a-1cc9-492e-b3ca-9e7088c66d27 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:10.984494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 753/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:02:10 2022] PUT /identity/v3/projects/3434b4062a0944d0a286fe5636673d12/users/4965911ab18341c1966f4d2dca78bed2/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:02:10.997215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ebbb1-6e73-48c5-89af-bab788a13dda None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:10.997501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ebbb1-6e73-48c5-89af-bab788a13dda None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:10.997777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ebbb1-6e73-48c5-89af-bab788a13dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.056543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9f9ebbb1-6e73-48c5-89af-bab788a13dda None None] MFA Rules not processed for user `4965911ab18341c1966f4d2dca78bed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:11.058034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9f9ebbb1-6e73-48c5-89af-bab788a13dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:11.137885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 749/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:11.154068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:11.154352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:11.154655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.156053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 754/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Sep 7 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:11.160920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470e21-96c7-4814-b5c3-be4e42982f78 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:11.161198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470e21-96c7-4814-b5c3-be4e42982f78 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:11.161468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470e21-96c7-4814-b5c3-be4e42982f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.193285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:11.240279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-19470e21-96c7-4814-b5c3-be4e42982f78 None None] MFA Rules not processed for user `8c44a2759eab46dbae21ad7eeb96df9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:11.241492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19470e21-96c7-4814-b5c3-be4e42982f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:11.318491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 750/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Sep 7 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:02:11.328175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:11.329678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:11.380314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:11.435705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fa423-7e1a-4afb-88d3-ee2d7bd3149f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:11.510291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:11.510816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:11.511096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:11.511368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.513000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:11.612883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:11.615160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:11.618739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:11.633843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 755/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:11.679508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6b02-61a5-40fd-abc1-c2c8407c5e88 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:11.679940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6b02-61a5-40fd-abc1-c2c8407c5e88 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:11.680042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6b02-61a5-40fd-abc1-c2c8407c5e88 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.681289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 751/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Sep 7 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:11.685152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:11.686404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:11.787894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240595da-2c46-47de-a472-8d8175b339bb service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:11.884436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:11.885122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:11.885328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:11.885603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] PATH_INFO: `/v3/users/4965911ab18341c1966f4d2dca78bed2` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:11.898944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4965911ab18341c1966f4d2dca78bed2)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:11.900010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:11.900010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:02:11.900010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:02:11.901228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:11.911865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:11.970230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4965911ab18341c1966f4d2dca78bed2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:11.981637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4965911ab18341c1966f4d2dca78bed2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:11.982103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4965911ab18341c1966f4d2dca78bed2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:11.982632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4965911ab18341c1966f4d2dca78bed2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:11.997373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4965911ab18341c1966f4d2dca78bed2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:12.029144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 756/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:02:11 2022] DELETE /identity/v3/users/4965911ab18341c1966f4d2dca78bed2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:02:12.033501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.033789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.034065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.095953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:12.097093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.171936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:12.185945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 752/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:02:12.196086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:12.197409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.301044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e1b63-b865-4c4c-9ac8-413a55d91c16 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:12.357786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:12.382393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:12.383004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.383281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.383583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.385181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.494416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:12.495912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8bf18-8f91-45b9-8668-fdbcb610abf8 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:12.520843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 757/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:02:12.861074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:12.862408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:12.874740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb167c55-f515-4981-9cfa-bc24a058bf5e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:12.975247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:12.975912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:12.976239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:12.976546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] PATH_INFO: `/v3/projects/3434b4062a0944d0a286fe5636673d12` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:12.987033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3434b4062a0944d0a286fe5636673d12)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:12.988078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:02:12.988078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:02:12.988078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:02:12.990348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:13.053531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3434b4062a0944d0a286fe5636673d12', 'request_id': 'req-0beb174a-e7fd-484e-be53-49f1d0f909d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:13.063976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3434b4062a0944d0a286fe5636673d12', 'request_id': 'req-0beb174a-e7fd-484e-be53-49f1d0f909d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:13.071516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3434b4062a0944d0a286fe5636673d12', 'request_id': 'req-0beb174a-e7fd-484e-be53-49f1d0f909d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:13.103238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] The token cache is being invalidate because project 3434b4062a0944d0a286fe5636673d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:02:13.103553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:13.103983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0beb174a-e7fd-484e-be53-49f1d0f909d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:02:13.105376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 753/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:02:12 2022] DELETE /identity/v3/projects/3434b4062a0944d0a286fe5636673d12 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:02:22.516898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=62 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:23.101183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:52.738209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:52.738804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:52.738804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:52.740188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:52.745430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f54dc-050d-4d24-a69c-449179e4af8e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:52.745839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f54dc-050d-4d24-a69c-449179e4af8e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:52.745985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f54dc-050d-4d24-a69c-449179e4af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:52.829555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e13f54dc-050d-4d24-a69c-449179e4af8e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:52.830779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e13f54dc-050d-4d24-a69c-449179e4af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:52.945493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:03:53.103237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:53.105427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:53.226892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20497abb-2ace-4815-b7d3-8461f7ab86a5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:53.232459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:53.233067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:53.233346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:53.233613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:53.242784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:53.244961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c903b-17a8-482c-96b2-8ca49ca6cec4 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:53.262078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 759/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:03:53.868459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cccd1-0ab9-4af8-87d3-ec5af22a0389 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:53.871963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cccd1-0ab9-4af8-87d3-ec5af22a0389 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:53.871963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cccd1-0ab9-4af8-87d3-ec5af22a0389 None None] PATH_INFO: `/v3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:53.871963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 755/1514] 10.222.0.55 () {54 vars in 925 bytes} [Wed Sep 7 13:03:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:53.877824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc35e-418c-4252-a442-525618c49fc0 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:53.878389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc35e-418c-4252-a442-525618c49fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:53.878389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cc35e-418c-4252-a442-525618c49fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:53.954595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-898cc35e-418c-4252-a442-525618c49fc0 None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:53.956017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-898cc35e-418c-4252-a442-525618c49fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:54.022969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:54.029071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 760/1515] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Sep 7 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:03:54.365405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc1cf-97b7-4dfa-81f6-04fe5320910b None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:54.365687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc1cf-97b7-4dfa-81f6-04fe5320910b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:54.365962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cc1cf-97b7-4dfa-81f6-04fe5320910b None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:54.367309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:54.374380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58f1d-3964-48ee-8947-aed0814b4467 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:54.374713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58f1d-3964-48ee-8947-aed0814b4467 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:54.374985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58f1d-3964-48ee-8947-aed0814b4467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:54.394236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-64e58f1d-3964-48ee-8947-aed0814b4467 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:54.395417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-64e58f1d-3964-48ee-8947-aed0814b4467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:54.403679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:03:54.565753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cc1cf-97b7-4dfa-81f6-04fe5320910b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:54.580299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cc1cf-97b7-4dfa-81f6-04fe5320910b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:54.585838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:54.586425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:54.586703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:54.586978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:54.596348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:54.597939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecbfcc-24a2-44ea-85ee-17b3fba974af service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:54.608190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 757/1518] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:02.781477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762498c8-8cbd-4f54-9211-48d92109c807 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:02.781987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762498c8-8cbd-4f54-9211-48d92109c807 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:02.782100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762498c8-8cbd-4f54-9211-48d92109c807 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:02.783432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 762/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Sep 7 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:02.788683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad54cd8-3da8-460a-ba1d-f2fb66e115d6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:02.789174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad54cd8-3da8-460a-ba1d-f2fb66e115d6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:02.789292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad54cd8-3da8-460a-ba1d-f2fb66e115d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:02.809941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0ad54cd8-3da8-460a-ba1d-f2fb66e115d6 None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:02.811154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0ad54cd8-3da8-460a-ba1d-f2fb66e115d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:02.819722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 758/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Sep 7 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:02.827362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762498c8-8cbd-4f54-9211-48d92109c807 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:02.841375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762498c8-8cbd-4f54-9211-48d92109c807 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:02.846518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:02.847112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:02.847393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:02.847692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:02.857684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:02.860577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae1fa-0f10-4d17-8666-28c1e1bc1768 service placement] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:02.872070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 763/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:06.111082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e325-f2e2-4730-9d35-66ab58d6da59 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:06.111653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e325-f2e2-4730-9d35-66ab58d6da59 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:06.111653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929e325-f2e2-4730-9d35-66ab58d6da59 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:06.112963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:06.119214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640546a8-d788-4171-a53c-b9a86bb78d7d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:06.119683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640546a8-d788-4171-a53c-b9a86bb78d7d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:06.119789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640546a8-d788-4171-a53c-b9a86bb78d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:06.139360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-640546a8-d788-4171-a53c-b9a86bb78d7d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:06.140582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-640546a8-d788-4171-a53c-b9a86bb78d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:06.148521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:04:06.305131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929e325-f2e2-4730-9d35-66ab58d6da59 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:06.320162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929e325-f2e2-4730-9d35-66ab58d6da59 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:06.326120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:06.326715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:06.327002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:06.327270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:06.335418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:06.337011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592291a-e07b-4d72-b467-5b5cd31e0900 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:06.347639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 760/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:07.444007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2c00-2cba-48a7-9006-8d681fe9a9cb None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:07.444876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2c00-2cba-48a7-9006-8d681fe9a9cb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:07.444876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a2c00-2cba-48a7-9006-8d681fe9a9cb None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:07.446379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:07.453546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778a05-2c58-433b-9c9a-2344cc50423a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:07.454033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778a05-2c58-433b-9c9a-2344cc50423a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:07.454146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f778a05-2c58-433b-9c9a-2344cc50423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:07.473447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0f778a05-2c58-433b-9c9a-2344cc50423a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:07.474642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0f778a05-2c58-433b-9c9a-2344cc50423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:07.482538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:07.638630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a2c00-2cba-48a7-9006-8d681fe9a9cb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:07.652665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a2c00-2cba-48a7-9006-8d681fe9a9cb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:07.658908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:07.659522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:07.659801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:07.660086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:07.667946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:07.670374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0356574-ff28-45a1-b004-8e357d6d3193 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:07.679597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 766/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:04:12.011223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:12.011791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:12.011791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:12.013305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:12.018689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b50d-5c47-4eb9-b527-c6de3b3407ad None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:12.019103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b50d-5c47-4eb9-b527-c6de3b3407ad None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:12.019216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99b50d-5c47-4eb9-b527-c6de3b3407ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:12.039364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-5a99b50d-5c47-4eb9-b527-c6de3b3407ad None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:12.040593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5a99b50d-5c47-4eb9-b527-c6de3b3407ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:12.049148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:12.338178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:12.339958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:12.372691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:12.419788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a18c2-8f32-4a49-b920-1f7bb2016ec6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:12.423369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:12.423997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:12.424277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:12.424550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:12.433735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:12.435197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a2780-35f2-40b1-9ad9-8f6caf282a6b service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:12.444827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 763/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:14.659783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff2c0-d955-48de-a19e-3559e58161bc None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:14.660322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff2c0-d955-48de-a19e-3559e58161bc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:14.660322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff2c0-d955-48de-a19e-3559e58161bc None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:14.661653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:14.666966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eff38-732a-43a4-8fa5-35bc73c1bede None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:14.667411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eff38-732a-43a4-8fa5-35bc73c1bede None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:14.667548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eff38-732a-43a4-8fa5-35bc73c1bede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:14.687914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ba3eff38-732a-43a4-8fa5-35bc73c1bede None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:14.689112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ba3eff38-732a-43a4-8fa5-35bc73c1bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:14.697066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:14.984447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff2c0-d955-48de-a19e-3559e58161bc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:14.995300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff2c0-d955-48de-a19e-3559e58161bc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:14.999371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:15.000013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:15.000285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:15.000550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:15.009042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:15.010491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ef690-ee3a-46f8-89f8-0d55414768be service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:15.020418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 769/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:18.684548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:18.685191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:18.685191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:18.686525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:18.691951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d336fc-3b3f-484a-9510-0af88d0a556c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:18.692389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d336fc-3b3f-484a-9510-0af88d0a556c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:18.692529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d336fc-3b3f-484a-9510-0af88d0a556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:18.712129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-08d336fc-3b3f-484a-9510-0af88d0a556c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:18.713326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-08d336fc-3b3f-484a-9510-0af88d0a556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:18.722136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:19.026012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:19.028346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:19.106479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f0d5-b2bd-4b6d-9c69-419b77a69c26 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:19.110032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:19.110630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:19.110907 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:19.111178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:19.120259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:19.122278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cacad-611b-42ae-8748-43b68e0ebc78 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:19.131629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 766/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:04:21.295317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:21.295917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:21.295917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:21.297268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:04:21.302502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1ec5-8ed3-4917-b2a3-bba4a2e7b52f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:21.302936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1ec5-8ed3-4917-b2a3-bba4a2e7b52f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:21.303044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee1ec5-8ed3-4917-b2a3-bba4a2e7b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:21.322682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6cee1ec5-8ed3-4917-b2a3-bba4a2e7b52f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:04:21.323923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6cee1ec5-8ed3-4917-b2a3-bba4a2e7b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:21.332223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:04:21.637970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:04:21.639682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:04:21.652432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0670e01-aedd-444a-b79a-1655104a21d1 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:04:21.655999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:04:21.656583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:04:21.656858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:04:21.657127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:04:21.666439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:04:21.667888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b368-0231-4094-a154-5fa4e179e4c1 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:04:21.677007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 772/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:04:31.317795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=63 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:04:31.672933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=37 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:49.573708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d86c-290c-4fd5-b86d-975c1ceffb83 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.574369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d86c-290c-4fd5-b86d-975c1ceffb83 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.574369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d86c-290c-4fd5-b86d-975c1ceffb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.602541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9562d86c-290c-4fd5-b86d-975c1ceffb83 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.603980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9562d86c-290c-4fd5-b86d-975c1ceffb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.604749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4c50-d1b2-43a8-b8c4-87c269b9bec2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.605781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4c50-d1b2-43a8-b8c4-87c269b9bec2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.606273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf4c50-d1b2-43a8-b8c4-87c269b9bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.615238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 768/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.624881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78e66-94be-4de1-a0e0-58dba2c86485 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.625217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78e66-94be-4de1-a0e0-58dba2c86485 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.625437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78e66-94be-4de1-a0e0-58dba2c86485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.636889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0acf4c50-d1b2-43a8-b8c4-87c269b9bec2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.638930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0acf4c50-d1b2-43a8-b8c4-87c269b9bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.658677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 773/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:05:49.660006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f7d6-6a79-4948-84f2-3a9b9fb1b276 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.660198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e9c78e66-94be-4de1-a0e0-58dba2c86485 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.660320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f7d6-6a79-4948-84f2-3a9b9fb1b276 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.660551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f7d6-6a79-4948-84f2-3a9b9fb1b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.661615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e9c78e66-94be-4de1-a0e0-58dba2c86485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.676866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 769/1542] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.678186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155cb6-e55d-4818-9178-7ccad0ed393e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.678427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155cb6-e55d-4818-9178-7ccad0ed393e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.678723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca155cb6-e55d-4818-9178-7ccad0ed393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.699568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f7d6f7d6-6a79-4948-84f2-3a9b9fb1b276 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.704776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f7d6f7d6-6a79-4948-84f2-3a9b9fb1b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.712264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ca155cb6-e55d-4818-9178-7ccad0ed393e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.713425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 774/1543] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.714139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ca155cb6-e55d-4818-9178-7ccad0ed393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.714526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.714806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.715077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.722734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 770/1544] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.724071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b13f-5719-42b6-9e60-a7633b28eb68 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.724360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b13f-5719-42b6-9e60-a7633b28eb68 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.724629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17b13f-5719-42b6-9e60-a7633b28eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.737454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.738672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.744619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7b17b13f-5719-42b6-9e60-a7633b28eb68 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.745777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7b17b13f-5719-42b6-9e60-a7633b28eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.746473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 775/1545] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.747243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:49.754749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 771/1546] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.756025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113768-f5b0-42ac-9375-9ff29776b061 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.756297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113768-f5b0-42ac-9375-9ff29776b061 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.756564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86113768-f5b0-42ac-9375-9ff29776b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.758078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65df9e-9381-4b44-8f86-141d5c4e32e5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:49.762806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:49.763623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.764276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.764495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.765141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:49.765441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:49.766974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:05:49.766974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:05:49.766974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:05:49.767448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8c92-3488-463a-8b0d-51c948bdad4d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:49.776536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-86113768-f5b0-42ac-9375-9ff29776b061 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.777674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-86113768-f5b0-42ac-9375-9ff29776b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.780323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 776/1547] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:49.781393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b1e7-a2de-4a69-af8f-1bf8974d92a3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.781674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b1e7-a2de-4a69-af8f-1bf8974d92a3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.781945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b1e7-a2de-4a69-af8f-1bf8974d92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.792553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 772/1548] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.793937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2295dc-ac57-40ed-9571-9b3cd5f1ecca None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.794214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2295dc-ac57-40ed-9571-9b3cd5f1ecca None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.795025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2295dc-ac57-40ed-9571-9b3cd5f1ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.804720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e3f6b1e7-a2de-4a69-af8f-1bf8974d92a3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.806180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e3f6b1e7-a2de-4a69-af8f-1bf8974d92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.815048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5f2295dc-ac57-40ed-9571-9b3cd5f1ecca None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.815542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 777/1549] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.816388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5f2295dc-ac57-40ed-9571-9b3cd5f1ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.816905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1414-2414-4a84-8236-6d7c4a2b9e2d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.817195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1414-2414-4a84-8236-6d7c4a2b9e2d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.817469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc1414-2414-4a84-8236-6d7c4a2b9e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.829936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 773/1550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.831151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.831436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.831738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.837855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ddfc1414-2414-4a84-8236-6d7c4a2b9e2d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.839057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ddfc1414-2414-4a84-8236-6d7c4a2b9e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.847790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 778/1551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.849012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.849297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.849573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.851580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.852753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.861022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 774/1552] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.861870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:49.869735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.870918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.871146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e7210-d819-423c-be57-ac95f900bd50 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:49.876286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:49.877030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.877218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.877547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.878328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:49.878559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:49.880351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6893bc-2397-4904-a601-69a20251f044 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:49.881419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 779/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.883191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:49.893164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 775/1554] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:49.895176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093471-bef9-4577-8056-a4cfb7db8d30 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.895488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093471-bef9-4577-8056-a4cfb7db8d30 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.895890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2093471-bef9-4577-8056-a4cfb7db8d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.897855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9730-31da-41e5-928e-a9e1b5777dd1 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:49.902445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:49.903044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.903325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.903628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.904836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:49.906987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bcc52-83e0-418c-9314-073a62ed6e52 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:49.916417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f2093471-bef9-4577-8056-a4cfb7db8d30 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.917617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f2093471-bef9-4577-8056-a4cfb7db8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.926179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 776/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:49.927309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.927631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.928021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.951119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 780/1556] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:49.951349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.951546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:49.951546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:49.951730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:49.952384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:49.971196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:49.972433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:50.012981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 777/1557] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:50.014926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.026013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6aac-b315-4f8a-98fd-f9255b4e5b1d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.032393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.032929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.033204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.033473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.034121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.034492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.036038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.040753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 781/1558] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:50.041643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.052195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97833620-fdb8-4c24-83ff-26d08cf232c3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.063676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 778/1559] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.063875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.064007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.064103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.069917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a52c-015d-4f90-9e31-a721559f52ac admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.074053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 782/1560] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.074678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.080410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.081063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.081345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.081609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.082412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.082707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.084328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.086282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2dd91-bf98-4b58-92c1-6d65934ece1e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.092029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.093203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.093482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.093753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.094840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.096779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.097480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 779/1561] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.098225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.108674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6864-f439-4b80-afdb-b897ecf985f8 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.113284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.113868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.114143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.114409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.115030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.115324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.116965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.129164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 783/1562] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.129976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.132044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 780/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.133360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.144616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d3d-8ed7-4107-99c4-21d96eeabe3b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.178463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:50.195445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:50.199191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc2bc0-9090-4262-9b43-7e91c4904cf8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.202729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.203417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.203729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.203988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.204117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.204585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.204699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.204860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.204968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.205127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.205747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.206491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.206754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:05:50.206754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:05:50.206754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:05:50.208048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.221079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 781/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.221950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.237062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44053cf3-dd94-40d1-ab01-1dc2998cabc6 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.237879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 784/1565] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.238960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.241958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.242535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.242811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.243090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.243752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:50.244173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.245743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.248897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8f9af-903f-4cbf-836c-894220cf832c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.253488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.254074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.254357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.254659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.255285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.257266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.257458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 782/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:50.258231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.270476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e2783-13fd-4a1e-8fc2-c459f329df64 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.275153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.275768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.276052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.276320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.276937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.277936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:05:50.277936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:05:50.277936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:05:50.280053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.289085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 785/1567] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.289837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.317705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 783/1568] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.317705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.358595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c719-7109-45a0-96f3-1e4e65d0dbe7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.379648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4d51-5193-403c-9d8c-ae5e176f485a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.384593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.385195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.385480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.385751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.386376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.388958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.414957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 784/1569] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.414957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.419669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.420392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.420667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.420939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.421584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.423555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.424961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46356ac3-0fec-4ada-8e27-1ed6e698b688 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.429823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.430681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.430958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.431229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.431896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.433834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.452233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 786/1570] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.456595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.463270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 785/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.464190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.503917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:50.525061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dc78f-c380-418f-befa-2ac2b2dec983 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.529917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.530531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.530805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.531071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.531733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.532582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bff860-e14c-4ad4-bc59-6c266c5477d0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.533638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.537291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.538212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.538494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.538769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.539844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.541435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.556772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 786/1572] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.556772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.569301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 787/1573] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.569497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e1ab7-ea11-4262-861a-da4b42734866 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.569599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.581561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:50.632453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb8c2-4c98-4e94-9cc9-06afda74ee06 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.633013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.633419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.633698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.634022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.634620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.636599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.637293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.637893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.638207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.638479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.639107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.641146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.666441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 788/1574] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.666441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.666721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 787/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.666721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.675422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b54a4-0692-456d-b0bc-e846a602374a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.730550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8959ec-2cba-498f-9f64-4bd29ab9572f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.732863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.733577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.733851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.734502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.734756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.736593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.736762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.737268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.737575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.737851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.738524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.740256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.752298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 788/1576] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.753173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.762921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 789/1577] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.762921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.764693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acba9d-7f06-4b97-b247-a014ffe42b2d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.770338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.770949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.771228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.771554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.771861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4ff71-ab1b-4fe8-bebf-9fa8adc12ed3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.772300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.774402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.776419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.777000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.777276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.777546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.778162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.780746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.797491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 789/1578] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.798619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.804512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 790/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.805650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.810693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759c8-2e93-43c1-af81-0ba7a20888d1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.815317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.815932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.816056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d3ec-a112-4b4b-a8c1-3c1e9028546b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.816210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.816476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.817136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.818723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.820664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.821254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.821539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.821812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.822435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.824381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.830385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 790/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.832593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.845812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766294d4-c58f-441c-9c40-abacec134d75 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.846389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 791/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.847097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.851197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.851832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.852106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.852374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.853008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.854576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.856571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2f05-b49c-4af8-8be4-b374da7e7453 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.863022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.863735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.864105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.864366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.864988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.869243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 791/1582] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.869399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.869508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.877647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12345-b5d0-4849-bdb3-5642ac0e997c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.879047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:50.883983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.884617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.884872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.885169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.885782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.887360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.894384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 792/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:50 2022] POST /identity/v3/users => generated 303 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:50.894384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.899883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 792/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.900759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.905675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bf237-88f4-4767-92c2-e13c2b73ecc4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.910450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.911042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.911212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0b83d-9ff8-4d40-a656-8057edc70f96 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.911324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.911609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.912240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.913844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.915895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.916478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.916757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.917028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.917657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.919210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.928614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 793/1585] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.928614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.933370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 793/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.933370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.938850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77132867-e41a-4eca-a2f4-98b90822d61a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.941358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e20c1-4872-4c2d-8907-942b3707c04d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.943590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.944173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.944451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.944720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.945343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.946927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.947036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.947760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.948151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.948429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] PATH_INFO: `/v3/projects/6feeabc46f0a43728e2de195961f82b1/users/809fcd4bc90440539af13ea0d1c8cb0b/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.959618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 794/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.961088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.964393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feeabc46f0a43728e2de195961f82b1, user_id=809fcd4bc90440539af13ea0d1c8cb0b, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.965436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:05:50.965436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:05:50.965436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:05:50.967951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.971734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2437-38fa-408c-bf6c-3ef2ebc54240 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:50.976971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:50.977779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:50.978059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:50.978333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:50.978959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:50.980631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:50.981478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 794/1588] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:50 2022] PUT /identity/v3/projects/6feeabc46f0a43728e2de195961f82b1/users/809fcd4bc90440539af13ea0d1c8cb0b/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:50.982954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.995116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 795/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:50.995116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:50.995814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:51.006238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870db85e-caae-43cb-a520-5bedaf0cd7e6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.044315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a809a-b0d6-468c-8e6f-c9e364750b29 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.049654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.050191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.050471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.050740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.051371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.052975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.063999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 795/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.067985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.068141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.068141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.068141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.068141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.068753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.070498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.075198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da553c-5729-4fd0-a57c-a9c625a753c5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.080944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.081723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 796/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.081836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.081836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.082120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] PATH_INFO: `/v3/projects/be2fdd4f07d94684aabb53b73a014123/users/09278399bc0148e68f0c7204fe19dc59/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.082478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.092245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2bd1-a7a9-4bba-92a3-d89fdcb3f940 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.097427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.098017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.098296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.098566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.098681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2fdd4f07d94684aabb53b73a014123, user_id=09278399bc0148e68f0c7204fe19dc59, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.099330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.100942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.101354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.115276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 797/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.115276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.122071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 796/1593] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/be2fdd4f07d94684aabb53b73a014123/users/09278399bc0148e68f0c7204fe19dc59/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.122071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.127027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3538ee-19e6-4f77-b440-7b43f69207d6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.184188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b01189-078f-418f-90de-044845f7d626 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.184670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.185965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.186527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.186774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.187429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.189147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152e867-2760-4f9b-afbf-5c3df739427c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.189951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.190560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.190831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.191441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.191760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.193404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.199739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 798/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.201299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101575-cca4-4256-9342-2c83678017fc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.201906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101575-cca4-4256-9342-2c83678017fc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.202742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101575-cca4-4256-9342-2c83678017fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.203694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 797/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.204419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.215982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e3ce-7aae-43e0-951c-17451b15bdab admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.224857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bf101575-cca4-4256-9342-2c83678017fc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.226076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bf101575-cca4-4256-9342-2c83678017fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.228796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.229410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.229728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.229952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.230591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.232728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.235587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 799/1596] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:51.237624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf101575-cca4-4256-9342-2c83678017fc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.248456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf101575-cca4-4256-9342-2c83678017fc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.251058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 798/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.251932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.256958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.257637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.257918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.258196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] PATH_INFO: `/v3/projects/06299c7f146c4acf9e1d64b329bb8910/users/e0a620dd1aea4725a42d3f25ca1f324f/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.262042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3333c-896f-441f-b327-400b05bb66c4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.269458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.270080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.270360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.270643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.274718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.274718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.279975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06299c7f146c4acf9e1d64b329bb8910, user_id=e0a620dd1aea4725a42d3f25ca1f324f, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.282675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0276-9140-4076-9a0e-84d6d0f84774 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.284689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 799/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:51.285533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.297119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cda8c-12ad-46e6-b82d-3b3a2d24d7e2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.303366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 800/1599] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/06299c7f146c4acf9e1d64b329bb8910/users/e0a620dd1aea4725a42d3f25ca1f324f/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.304596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.304880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.305433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.335116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.336620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.344539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:51.366798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.367497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.367777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.368053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] PATH_INFO: `/v3/projects/44e8aaa875614f4a84557e6846f326f4/users/db51c324fddc472c871b077167c903e4/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.370710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:51.387839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e8aaa875614f4a84557e6846f326f4, user_id=db51c324fddc472c871b077167c903e4, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.391413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.413982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 800/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/44e8aaa875614f4a84557e6846f326f4/users/db51c324fddc472c871b077167c903e4/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.414804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.426794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 801/1601] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:51.427678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.441377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41687a-0047-40d2-8145-d0557050e3bc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.492495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fe7d1-cdd7-4824-9ed4-0a6970732fa5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.497144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.498341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.498951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.499069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] PATH_INFO: `/v3/projects/92f6a14b621f45da9791f71954929a54/users/7a8a52a175954db1bab6545353bb878d/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.504531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.505196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.505477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.505755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] PATH_INFO: `/v3/projects/2343945de3244eea88144bd85ab99c2e/users/b46b797365d64b2c895c8c5469efe920/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.514212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f6a14b621f45da9791f71954929a54, user_id=7a8a52a175954db1bab6545353bb878d, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.516940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.523311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2343945de3244eea88144bd85ab99c2e, user_id=b46b797365d64b2c895c8c5469efe920, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.527965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.534113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 801/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/92f6a14b621f45da9791f71954929a54/users/7a8a52a175954db1bab6545353bb878d/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.535173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.544497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 802/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/2343945de3244eea88144bd85ab99c2e/users/b46b797365d64b2c895c8c5469efe920/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.548537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.595151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbb2b4-eecc-4133-ab98-5f39829c007b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.625654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b7cce-2215-4fc2-9eeb-ce6a0d2dd165 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.630398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.631072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.631349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.631657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] PATH_INFO: `/v3/projects/ca0144420b4e4102b26d444566956e3c/users/558045a60b994127852115cb0e82cf89/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.648691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0144420b4e4102b26d444566956e3c, user_id=558045a60b994127852115cb0e82cf89, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.649380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.649620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.649894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.650158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.651642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.660394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.661846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7ab2-f29e-4731-8476-8de2fe7acbf1 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.670286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/ca0144420b4e4102b26d444566956e3c/users/558045a60b994127852115cb0e82cf89/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.671799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.677525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 802/1605] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:51.679151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb902-cee7-4c2f-a4e9-360c27574ccb None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.679151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb902-cee7-4c2f-a4e9-360c27574ccb None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.679151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afb902-cee7-4c2f-a4e9-360c27574ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.705616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:51.715605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-70afb902-cee7-4c2f-a4e9-360c27574ccb None None] MFA Rules not processed for user `e0a620dd1aea4725a42d3f25ca1f324f`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.717323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-70afb902-cee7-4c2f-a4e9-360c27574ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.733510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:51.768877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bae4e-63c3-4281-88a5-01c8a3e21d19 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.775413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.776855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.776855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.776855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] PATH_INFO: `/v3/projects/00e52da2e937490bbe2b128debc9e2b9/users/87a82ee7561b4bc68fa296a352a9736e/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.802765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e52da2e937490bbe2b128debc9e2b9, user_id=87a82ee7561b4bc68fa296a352a9736e, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.805103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.809930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 803/1606] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:51.811993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f0b4-9385-4fc8-8194-7e1309b866b9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.812360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f0b4-9385-4fc8-8194-7e1309b866b9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.812710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f0b4-9385-4fc8-8194-7e1309b866b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.836175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 804/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:51 2022] PUT /identity/v3/projects/00e52da2e937490bbe2b128debc9e2b9/users/87a82ee7561b4bc68fa296a352a9736e/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:51.838721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-02f3f0b4-9385-4fc8-8194-7e1309b866b9 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.840718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:51.841077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-02f3f0b4-9385-4fc8-8194-7e1309b866b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.919037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86156c-d8ec-4703-82f1-1041c5d3a899 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:51.925447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 804/1608] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:51.925620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:51.925755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a218-2c1f-47d5-a782-ff87ce16fead None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.925859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.926430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a218-2c1f-47d5-a782-ff87ce16fead None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.926540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.926630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a218-2c1f-47d5-a782-ff87ce16fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.926715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.940715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:51.942196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49196b7-2014-4fad-9c63-4622e86e5dcf service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:51.947142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2454a218-2c1f-47d5-a782-ff87ce16fead None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.948501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2454a218-2c1f-47d5-a782-ff87ce16fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.953304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 805/1609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:51.954352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118bbb-0b57-45ec-9833-4b9e8a3a5abd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.954628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118bbb-0b57-45ec-9833-4b9e8a3a5abd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.954900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118bbb-0b57-45ec-9833-4b9e8a3a5abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.957597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 805/1610] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:51.958922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:51.959128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:51.959392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:51.993195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-16118bbb-0b57-45ec-9833-4b9e8a3a5abd None None] MFA Rules not processed for user `b46b797365d64b2c895c8c5469efe920`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.993337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] MFA Rules not processed for user `558045a60b994127852115cb0e82cf89`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:51.994568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:51.995128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-16118bbb-0b57-45ec-9833-4b9e8a3a5abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:52.076844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 806/1611] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:52.076844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.087044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57989c-f5ce-4767-aef0-17da70fee1ba None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.093415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.094069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.094348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.095696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.095696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.098223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.116834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 806/1612] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:52.116834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.116834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.116834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.150577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 807/1613] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:52 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:52.153063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.156865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:52.159839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:52.161385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:52.183690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:52.237550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daeb40-a2d1-4032-99f5-5987c40eca55 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.242614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.243444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:52.244269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.244629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.244900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.316650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 807/1614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:52.319058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.352621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d80d6-60f4-4788-b8c0-c5a24af45953 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.360589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.361344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.361567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.361874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.371777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.374165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7911dff-1c78-4a8e-b9c1-024af9582afb service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.380714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.382912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.384959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 808/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:52.386335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be96a-2712-4760-b4f0-2d7dd20e7c93 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.386752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be96a-2712-4760-b4f0-2d7dd20e7c93 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.387110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be96a-2712-4760-b4f0-2d7dd20e7c93 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.389329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 809/1616] 10.222.0.18 () {54 vars in 962 bytes} [Wed Sep 7 13:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:05:52.390228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be96a-2712-4760-b4f0-2d7dd20e7c93 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.400861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 808/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:52.402176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.416556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b427c3-f9bd-4786-ad43-a2cd96f59c4a service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.431118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.432191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.432544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.433078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.435808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.439528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.479745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 809/1618] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:52 2022] POST /identity/v3/users => generated 308 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:52.479745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.486487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be96a-2712-4760-b4f0-2d7dd20e7c93 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.490050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da777ff1-69cb-4ac8-bef6-f02ca311b8a9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.492813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.493604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.494066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.494346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.495252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.496167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.496547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.496925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.512479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.515186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15463e5d-edab-4480-ba02-a99baf2fc058 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.529033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 810/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:52.531821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.532214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.532725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.582824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:52.584181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.584619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:52.586337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.605517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 810/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:52.609036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.624781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ae01b-751f-4b49-8d09-97ef9dd78707 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.631288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.631961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.632242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.632514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.633544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.635342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.651296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 811/1621] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:52.652828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.666786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded498a-9e1b-4527-babc-28538dba86bc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.667395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 811/1622] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Sep 7 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:52.679865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.687520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.688309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.688591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.688867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] PATH_INFO: `/v3/projects/cd793905a2e64a719ac944f26bc89f51/users/e50c80ea67e945b4bfd11c6e7a0aa892/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.695873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d64d1-4560-4771-9bb0-f5cd76a76898 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.710158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.710880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd793905a2e64a719ac944f26bc89f51, user_id=e50c80ea67e945b4bfd11c6e7a0aa892, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.711026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.711338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.711741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.713937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.728827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:52.747263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 812/1623] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:52 2022] PUT /identity/v3/projects/cd793905a2e64a719ac944f26bc89f51/users/e50c80ea67e945b4bfd11c6e7a0aa892/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:52.749451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.811366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:52.838645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c313eb-71a7-40f1-bb56-ca6915f5aaaf admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.840277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.845520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.845938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.846193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.846479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.846754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.847548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.849987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93036d6-8021-4c37-bbf1-bba3f4c8e69e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.857674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 812/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:05:52.866033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 813/1625] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:52.866624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:52.879141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c59be6-7e2e-4b95-ba8f-2d54bb088b80 service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:52.884535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:52.885289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.885631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.886104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] PATH_INFO: `/v3/projects/cd793905a2e64a719ac944f26bc89f51/users/e50c80ea67e945b4bfd11c6e7a0aa892/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.889123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd793905a2e64a719ac944f26bc89f51, user_id=e50c80ea67e945b4bfd11c6e7a0aa892, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:52.891883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:52.913164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 813/1626] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:52 2022] PUT /identity/v3/projects/cd793905a2e64a719ac944f26bc89f51/users/e50c80ea67e945b4bfd11c6e7a0aa892/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:05:52.923063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32d7f-190d-4bcc-bb93-fdec5fbca6bc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:52.923321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32d7f-190d-4bcc-bb93-fdec5fbca6bc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:52.923658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32d7f-190d-4bcc-bb93-fdec5fbca6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:52.988433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0bc32d7f-190d-4bcc-bb93-fdec5fbca6bc None None] MFA Rules not processed for user `e50c80ea67e945b4bfd11c6e7a0aa892`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:52.991156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0bc32d7f-190d-4bcc-bb93-fdec5fbca6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:53.122150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 814/1627] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:53.123914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:53.237368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942e7e-1211-4fa9-80c2-10745d340c2b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:53.248715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:53.249430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:53.249705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:53.249971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:53.257810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919998-6096-46c4-840b-f824c04e37a8 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:53.258306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919998-6096-46c4-840b-f824c04e37a8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:53.258704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3919998-6096-46c4-840b-f824c04e37a8 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:53.261184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 815/1628] 10.222.0.18 () {54 vars in 912 bytes} [Wed Sep 7 13:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:05:53.269673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:53.270508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:53.270973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:53.272900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:53.274446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:53.301723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 814/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:53.315817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:53.317734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:53.490647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:53.513847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:53.526279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f75d-c0e3-41e4-96ed-f051814f3580 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:53.536099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:53.536917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:53.537389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:53.537708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:53.559959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:53.563717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54356f7-9397-4328-8c73-f19f9c7a2497 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:53.607432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 815/1631] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:53.836425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:53.946775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:53.969806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272551f0-8477-4ff2-a431-605851f52ac6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:53.986177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:53.986907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:53.987253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:53.987783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] PATH_INFO: `/v3/users/e0a620dd1aea4725a42d3f25ca1f324f` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:53.989018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a620dd1aea4725a42d3f25ca1f324f)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:53.991825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.112896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a620dd1aea4725a42d3f25ca1f324f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:54.139835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a620dd1aea4725a42d3f25ca1f324f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:54.140393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a620dd1aea4725a42d3f25ca1f324f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:54.141611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a620dd1aea4725a42d3f25ca1f324f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:54.163170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0ee41fa9-b6c1-4230-88de-f350b4a4139c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a620dd1aea4725a42d3f25ca1f324f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:54.215822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:05:53 2022] DELETE /identity/v3/users/e0a620dd1aea4725a42d3f25ca1f324f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:54.226090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.226561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.226665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.237510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.237796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.238075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.270633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:54.272146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:54.275045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] MFA Rules not processed for user `87a82ee7561b4bc68fa296a352a9736e`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:54.277800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:54.392219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 818/1633] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:54.394607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.398526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:54.409073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 816/1634] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:54.418509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.420199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:54.439312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a8df3-dd36-48e2-b986-b444ce3b541c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.448268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:54.449139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.449424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.449878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.450553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:54.454648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.492809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:54.512947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 819/1635] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:54 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:54.515454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.545071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc898-284d-4bb5-870e-c9e495731003 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.596946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:54.651968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89274-aad4-4f6b-ab64-c184c12084a3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.661589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:54.662464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.662464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.662796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.663428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:54.667157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.704952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:54.707623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.707912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.708189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.729355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 820/1636] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:54 2022] POST /identity/v3/users => generated 309 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:54.729752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:54.731143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.731281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.743394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 817/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:05:54.757309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47ac6-1355-4759-8f5b-14cf6b93587c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.772522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:54.773460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.773753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.774012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.774750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:54.782047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.829732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 821/1638] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:54.834993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.855246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3aba9-fe07-4500-85f6-e168ce507548 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.865488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:54.866315 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.866708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.866989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] PATH_INFO: `/v3/projects/e7a2c794eef740159e4784d83c319a38/users/cda48e9df71b48b6acc5d69637b8f2c2/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.893617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a2c794eef740159e4784d83c319a38, user_id=cda48e9df71b48b6acc5d69637b8f2c2, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:54.897454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac3a42-ed83-438b-811b-102fc99cd98d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:54.923377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 818/1639] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:54 2022] PUT /identity/v3/projects/e7a2c794eef740159e4784d83c319a38/users/cda48e9df71b48b6acc5d69637b8f2c2/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:54.927590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:54.949227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a176f-bdf7-438c-8056-0a20a304c0ce admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:54.955505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e2c9-e0b1-42c4-8ad3-b027fe6f1a20 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.955840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e2c9-e0b1-42c4-8ad3-b027fe6f1a20 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.956342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5e2c9-e0b1-42c4-8ad3-b027fe6f1a20 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:54.961652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 819/1640] 10.222.0.18 () {54 vars in 962 bytes} [Wed Sep 7 13:05:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:05:54.972104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b924-e38c-467f-9b2b-fb9a0883dc8d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:54.973031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b924-e38c-467f-9b2b-fb9a0883dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:54.973659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40b924-e38c-467f-9b2b-fb9a0883dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.016368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-dd40b924-e38c-467f-9b2b-fb9a0883dc8d None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:55.017785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dd40b924-e38c-467f-9b2b-fb9a0883dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:55.101580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:55.102624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.103066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.103633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.104702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:55.108198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:55.129796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 820/1641] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Sep 7 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:55.142076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fc3-e59a-4487-adb3-aa22d75535f5 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.142522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fc3-e59a-4487-adb3-aa22d75535f5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.143058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4959fc3-e59a-4487-adb3-aa22d75535f5 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.146079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 821/1642] 10.222.0.18 () {54 vars in 912 bytes} [Wed Sep 7 13:05:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:05:55.173235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 822/1643] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:55.175775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:55.175910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.177877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.178256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.190826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ec2d9-1256-45ad-8bdd-6d19c4c83be4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:55.199191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:55.200122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.201139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.201887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] PATH_INFO: `/v3/projects/e7a2c794eef740159e4784d83c319a38/users/cda48e9df71b48b6acc5d69637b8f2c2/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.204356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a2c794eef740159e4784d83c319a38, user_id=cda48e9df71b48b6acc5d69637b8f2c2, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:55.209345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:55.230134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 823/1644] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:55 2022] PUT /identity/v3/projects/e7a2c794eef740159e4784d83c319a38/users/cda48e9df71b48b6acc5d69637b8f2c2/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:55.237694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:55.239059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:55.378198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:55.415604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 822/1645] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:55.429679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:55.432359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:55.511211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a2672-cee6-4ca1-baa7-be68f738b5a8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:55.516671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:55.517533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.517915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.518341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.533831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:55.535813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:55.548984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:55.550492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:55.570590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 824/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:05:55.773068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c12ed-5ba8-4e5f-be34-65710a630f81 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:55.787842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:55.788510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:55.789074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:55.789074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] PATH_INFO: `/v3/projects/06299c7f146c4acf9e1d64b329bb8910` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:55.790210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06299c7f146c4acf9e1d64b329bb8910)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:55.792825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:55.942832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06299c7f146c4acf9e1d64b329bb8910', 'request_id': 'req-93f394ed-9969-41d1-b003-346677231ee1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:55.942832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06299c7f146c4acf9e1d64b329bb8910', 'request_id': 'req-93f394ed-9969-41d1-b003-346677231ee1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:55.956955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06299c7f146c4acf9e1d64b329bb8910', 'request_id': 'req-93f394ed-9969-41d1-b003-346677231ee1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:55.969350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] The token cache is being invalidate because project 06299c7f146c4acf9e1d64b329bb8910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:05:55.969665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:55.970366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-93f394ed-9969-41d1-b003-346677231ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:55.975118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 823/1647] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:05:55 2022] DELETE /identity/v3/projects/06299c7f146c4acf9e1d64b329bb8910 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:05:55.976857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:55.994282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e5922-75a3-4c25-8c45-422bc2fdf07e service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:56.093342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:56.149311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:56.150951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:56.151378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:56.151880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] PATH_INFO: `/v3/users/e50c80ea67e945b4bfd11c6e7a0aa892` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:56.154556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e50c80ea67e945b4bfd11c6e7a0aa892)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:56.158353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:56.273197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e50c80ea67e945b4bfd11c6e7a0aa892'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:56.291588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e50c80ea67e945b4bfd11c6e7a0aa892'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:56.292565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e50c80ea67e945b4bfd11c6e7a0aa892'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:56.293468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e50c80ea67e945b4bfd11c6e7a0aa892'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:56.307115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e50c80ea67e945b4bfd11c6e7a0aa892'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:56.412753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 825/1648] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:05:55 2022] DELETE /identity/v3/users/e50c80ea67e945b4bfd11c6e7a0aa892 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:56.749191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac2b9-5243-4290-ac3d-1c50ba8f0d0a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:56.749646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac2b9-5243-4290-ac3d-1c50ba8f0d0a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:56.752774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ac2b9-5243-4290-ac3d-1c50ba8f0d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:56.816769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-531ac2b9-5243-4290-ac3d-1c50ba8f0d0a None None] MFA Rules not processed for user `cda48e9df71b48b6acc5d69637b8f2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:56.818042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-531ac2b9-5243-4290-ac3d-1c50ba8f0d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:56.995509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 824/1649] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:58.152078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:58.154910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:58.303663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94693f1-754f-40c5-b4ef-7783e41b406a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:58.316024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:58.317131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:58.317359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:58.317709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] PATH_INFO: `/v3/projects/cd793905a2e64a719ac944f26bc89f51` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:58.319112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd793905a2e64a719ac944f26bc89f51)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:58.320833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: WARNING py.warnings [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:05:58.320833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: warnings.warn(msg) Sep 07 13:05:58.320833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: Sep 07 13:05:58.322886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:58.574904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd793905a2e64a719ac944f26bc89f51', 'request_id': 'req-d80ed820-9c0a-431b-bf31-8c0d9590470b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:58.622070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd793905a2e64a719ac944f26bc89f51', 'request_id': 'req-d80ed820-9c0a-431b-bf31-8c0d9590470b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:58.644272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd793905a2e64a719ac944f26bc89f51', 'request_id': 'req-d80ed820-9c0a-431b-bf31-8c0d9590470b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:58.663963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:58.758276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] The token cache is being invalidate because project cd793905a2e64a719ac944f26bc89f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:05:58.758276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:58.759091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d80ed820-9c0a-431b-bf31-8c0d9590470b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:58.765479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 826/1650] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:05:58 2022] DELETE /identity/v3/projects/cd793905a2e64a719ac944f26bc89f51 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:58.767166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:58.767657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:58.768681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:58.784865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:05:58.821018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:58.822541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:59.041853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 825/1651] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:05:59.052303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.052790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.053262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.097955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:59.099266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:59.117661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 827/1652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:05:59.121743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.142827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bfbdb-ae34-4b36-a6c5-67654c81cb6e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.161588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.162249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.163184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.163589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.164390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:05:59.164700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.172630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.230684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 826/1653] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:05:59.240667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.258850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31cde-cb6b-4c99-9bc5-5b432a5ed7e8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.285004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.285646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.285976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.286177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.286829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.288847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.414452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 828/1654] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:05:59 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:59.418821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.438491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2187744-c1ae-4605-807c-80709374b79b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.467112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.470905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:59.672801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a752e-8250-4d9e-8823-241baeadf9b9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.681915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.682638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.683030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.683354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] PATH_INFO: `/v3/users/558045a60b994127852115cb0e82cf89` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.684504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558045a60b994127852115cb0e82cf89)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.688225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.694338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.694973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.695250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.695552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.696211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.698139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.742898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 827/1655] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:05:59 2022] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:05:59.750971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.773088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a0ed-48f7-49a8-a36f-01a311bf5cd3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.786339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.786877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.787157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.787438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.788121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.789735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.792885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558045a60b994127852115cb0e82cf89'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:59.812329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558045a60b994127852115cb0e82cf89'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:59.814907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558045a60b994127852115cb0e82cf89'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:59.815839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558045a60b994127852115cb0e82cf89'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:59.823293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 828/1656] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:59.829802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.848041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:05:59.851454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a3cf4673-bf4e-4e43-bb02-8e58f470dc17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558045a60b994127852115cb0e82cf89'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:05:59.868271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd4fb-27f2-4cca-98ec-4bbf684032eb admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.875617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:05:59.876975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.877510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.878185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.879162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:05:59.881967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:05:59.891997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 829/1657] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:05:59 2022] DELETE /identity/v3/users/558045a60b994127852115cb0e82cf89 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:05:59.893598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:05:59.893893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:05:59.894172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:05:59.897863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 829/1658] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:05:59.902459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:05:59.939806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a81e1-43fc-4659-ae8f-fdd96a46aef2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:05:59.946762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:05:59.950184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:00.020711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:00.025351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:00.026164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.026809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.026809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] PATH_INFO: `/v3/projects/242cccfeda7c466d93337dddbedf03b4/users/c1955b973ae84af6940a8b1f139fa639/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.048160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242cccfeda7c466d93337dddbedf03b4, user_id=c1955b973ae84af6940a8b1f139fa639, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:00.053427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:00.055906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1138a-d1d4-4f1b-bbcf-40bc1a8c72a1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:00.090621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 830/1659] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:05:59 2022] PUT /identity/v3/projects/242cccfeda7c466d93337dddbedf03b4/users/c1955b973ae84af6940a8b1f139fa639/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:00.093066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213bf9-d384-4d2c-b866-a21f322caf19 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.093629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213bf9-d384-4d2c-b866-a21f322caf19 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.093980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79213bf9-d384-4d2c-b866-a21f322caf19 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.095456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 831/1660] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:00.100716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb4dd-f8c9-40c0-a6e0-b1addcae52bd None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.101221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb4dd-f8c9-40c0-a6e0-b1addcae52bd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.101574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb4dd-f8c9-40c0-a6e0-b1addcae52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.105535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 830/1661] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:00.114586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:00.116224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:00.148654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2adcb4dd-f8c9-40c0-a6e0-b1addcae52bd None None] MFA Rules not processed for user `c1955b973ae84af6940a8b1f139fa639`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:00.150643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2adcb4dd-f8c9-40c0-a6e0-b1addcae52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:00.278049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 832/1662] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:00.281834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.282288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.282509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.305641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000dd14-f331-44ec-9b34-b75f77a56930 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:00.365061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:00.367393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:00.428956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:00.429757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.430408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.430784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.580105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 833/1663] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:00.589083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:00.590605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:00.595562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:00.612675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 831/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:00.627570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:00.629666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:00.652695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c09c6-e0f5-41e4-b010-70fae006103a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:00.667152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6cf7-5372-4cce-a053-d0cfe5b49fbe service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:00.673995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:00.674638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.674954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:00.675074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.675224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.675873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.675980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:00.676317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.676687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.681369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:00.706636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:00.710951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:00.750242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 832/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:00.762520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 834/1666] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:00 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:00.767904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:00.786532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f05c-fa66-40e0-94ca-4d4ce987ef7a service placement] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:00.872057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:00.953567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:00.955230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:00.955547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:00.956144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:00.966283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:00.969248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.033044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 833/1667] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:00 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:01.033252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.047791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef590e16-1ba6-4b4a-8db6-0a79d3650174 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.058197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.060516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.061107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.061642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.062540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.064526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.100933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 835/1668] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:01.104822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.122449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f79a6e-a889-425f-9787-8b90b12976ee admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.139583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.140293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.140577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.140850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] PATH_INFO: `/v3/projects/3106291ea1ae495b8296ec98968c0801/users/36c56c73fdf648e7b5ba04a27d5ded91/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.178389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3106291ea1ae495b8296ec98968c0801, user_id=36c56c73fdf648e7b5ba04a27d5ded91, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.181826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.213522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 834/1669] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:01 2022] PUT /identity/v3/projects/3106291ea1ae495b8296ec98968c0801/users/36c56c73fdf648e7b5ba04a27d5ded91/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:01.214999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.234411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f31ba-8995-46c8-8ce5-492c7bdf4f16 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.295970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:01.340449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.343602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.344058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.344962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.346487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.350106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a7e61-fb64-4c61-8807-4a11e267f7a2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.387795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 836/1670] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:01.392920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.411117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c1bf-d924-431a-b447-4aa9feefdbb3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.432590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.433967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.435679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.437529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] PATH_INFO: `/v3/projects/3106291ea1ae495b8296ec98968c0801/users/36c56c73fdf648e7b5ba04a27d5ded91/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.442170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3106291ea1ae495b8296ec98968c0801, user_id=36c56c73fdf648e7b5ba04a27d5ded91, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.446743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.466396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 835/1671] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:01 2022] PUT /identity/v3/projects/3106291ea1ae495b8296ec98968c0801/users/36c56c73fdf648e7b5ba04a27d5ded91/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:01.477575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.478139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.478427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.541066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] MFA Rules not processed for user `36c56c73fdf648e7b5ba04a27d5ded91`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:01.542855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:01.596636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.598860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:01.671779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 837/1672] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:01.695537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:01.700296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:01.767993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cac6-01ca-4236-8300-74f854fe12be admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.784222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.785024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.785309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.785582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] PATH_INFO: `/v3/projects/ca0144420b4e4102b26d444566956e3c` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.787908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0144420b4e4102b26d444566956e3c)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.791275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.854869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f4cd4-7ecd-44fe-b746-150c3a70f1e2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:01.862957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:01.865646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.866349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.866885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.902938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0144420b4e4102b26d444566956e3c', 'request_id': 'req-7e9a7385-0452-4586-bc55-813f9dbd5f2a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:01.916183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0144420b4e4102b26d444566956e3c', 'request_id': 'req-7e9a7385-0452-4586-bc55-813f9dbd5f2a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:01.924799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0144420b4e4102b26d444566956e3c', 'request_id': 'req-7e9a7385-0452-4586-bc55-813f9dbd5f2a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:01.939948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] The token cache is being invalidate because project ca0144420b4e4102b26d444566956e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:01.940783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:01.941756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7e9a7385-0452-4586-bc55-813f9dbd5f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:01.944235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 836/1673] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:01 2022] DELETE /identity/v3/projects/ca0144420b4e4102b26d444566956e3c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:01.949111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641109-6bdc-4bac-8a16-fea31362131c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:01.949667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641109-6bdc-4bac-8a16-fea31362131c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:01.950151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641109-6bdc-4bac-8a16-fea31362131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:01.997912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:01.999829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fcfb0-24b5-4c32-8f15-3bd6bdcc1641 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:01.999948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e3641109-6bdc-4bac-8a16-fea31362131c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:02.005288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e3641109-6bdc-4bac-8a16-fea31362131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.012743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 838/1674] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:02.040880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:02.173592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 837/1675] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:02.181853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731df6-5143-4290-801b-1794e30c3ed4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.182301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731df6-5143-4290-801b-1794e30c3ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.182528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731df6-5143-4290-801b-1794e30c3ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.227495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5592c1-e6f6-4a60-8271-5dc62898908f None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.227826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5592c1-e6f6-4a60-8271-5dc62898908f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.228056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5592c1-e6f6-4a60-8271-5dc62898908f None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.229829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 838/1676] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:02.240117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-87731df6-5143-4290-801b-1794e30c3ed4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:02.244011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-87731df6-5143-4290-801b-1794e30c3ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.265568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 839/1677] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:02.266827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5592c1-e6f6-4a60-8271-5dc62898908f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:02.287617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5592c1-e6f6-4a60-8271-5dc62898908f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:02.312429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.312597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.312803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.321750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:02.324297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:02.328314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.328880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.330569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.333244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:02.334271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:02.340197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:02.363200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:02.370852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.389562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 839/1678] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:02.397283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:02.419407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713000ad-bcde-4df4-87b4-b4525882e4f0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:02.439173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:02.439946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.440796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.440796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.441634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:02.445219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:02.503512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 840/1679] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:02.505141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 840/1680] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:02 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:02.510889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:02.535636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9e74-fd08-4a31-a7b2-0465f825a47e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:02.619069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:02.620881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.648470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:02.649101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.649468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.649637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.651430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:02.662890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:02.730379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 841/1681] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:02 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:02.734299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:02.736697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:02.901958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566106-fe83-4139-a256-ad2c14bee4d1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:02.926338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:02.929129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.930828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.931558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] PATH_INFO: `/v3/users/87a82ee7561b4bc68fa296a352a9736e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.933232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a82ee7561b4bc68fa296a352a9736e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:02.939015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:02.948805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad985412-1077-4b20-8b96-cc79166989d9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:02.970472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:02.972905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:02.972905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:02.974031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:02.994126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:02.996801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:03.018366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 842/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:03.019520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.047671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20683a7-5c69-4c8f-b2d2-08cda51dd55e service placement] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:03.066543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:03.067447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.067769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.068114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.068800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:03.070531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:03.094094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a82ee7561b4bc68fa296a352a9736e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:03.096900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 843/1683] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:03.100720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.115968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a82ee7561b4bc68fa296a352a9736e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:03.116595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a82ee7561b4bc68fa296a352a9736e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:03.117360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a82ee7561b4bc68fa296a352a9736e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:03.126338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542dcd5-6c2f-4e43-b250-ea8915c6a500 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:03.132786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:03.133416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.133695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.133967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.134641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:03.136072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84661908-30ff-47f3-bb20-522883f26303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a82ee7561b4bc68fa296a352a9736e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:03.136299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:03.138288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:03.165278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 844/1684] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:03.171896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.176110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:03.178659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 841/1685] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:02 2022] DELETE /identity/v3/users/87a82ee7561b4bc68fa296a352a9736e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:03.208085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bddbf-7ce5-442d-8828-9c863280f3a5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:03.355449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:03.356201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.356475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.356843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] PATH_INFO: `/v3/projects/f887e580275648c080a249f6714a5058/users/686bd7b132374b47b39b8ddb54047514/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.406681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f887e580275648c080a249f6714a5058, user_id=686bd7b132374b47b39b8ddb54047514, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:03.411825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:03.456837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 845/1686] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:03 2022] PUT /identity/v3/projects/f887e580275648c080a249f6714a5058/users/686bd7b132374b47b39b8ddb54047514/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:03.469596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.470402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.470807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.483347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:03.564257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] MFA Rules not processed for user `686bd7b132374b47b39b8ddb54047514`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:03.565515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:03.729160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 842/1687] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:03.745132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.750965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:03.780800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:03.782480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:03.913125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd83933-c334-4644-8f38-a5979ec5e16f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:03.918962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:03.919677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:03.919962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:03.920228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:03.925624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:04.047559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.049176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.060742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 843/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:04.064851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6811-fa14-47b0-9289-64b820440daa admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:04.087735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:04.088426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.090288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.090579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.120393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.124261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.144450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:04.145932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:04.149723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 846/1689] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:04.275287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:04.316131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa11912-5e9c-4170-a1c7-9f4b0ca0abd8 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:04.328612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:04.329287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.329950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.329950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] PATH_INFO: `/v3/projects/00e52da2e937490bbe2b128debc9e2b9` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.331961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e52da2e937490bbe2b128debc9e2b9)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.334174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.451857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e52da2e937490bbe2b128debc9e2b9', 'request_id': 'req-13966105-72ff-4631-a774-187d9b77b814'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.469834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e52da2e937490bbe2b128debc9e2b9', 'request_id': 'req-13966105-72ff-4631-a774-187d9b77b814'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.482297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e52da2e937490bbe2b128debc9e2b9', 'request_id': 'req-13966105-72ff-4631-a774-187d9b77b814'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.537554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] The token cache is being invalidate because project 00e52da2e937490bbe2b128debc9e2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:04.537554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.538234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.544477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 844/1690] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:04 2022] DELETE /identity/v3/projects/00e52da2e937490bbe2b128debc9e2b9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:04.548605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:04.575200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82034-eb5f-4286-b13b-fd695a0a5691 service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:04.614155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:04.615855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:04.772210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966105-72ff-4631-a774-187d9b77b814 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:04.781208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:04.782714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.783001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.783274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] PATH_INFO: `/v3/users/cda48e9df71b48b6acc5d69637b8f2c2` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.785034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda48e9df71b48b6acc5d69637b8f2c2)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.786170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: WARNING py.warnings [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:06:04.786170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: warnings.warn(msg) Sep 07 13:06:04.786170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: Sep 07 13:06:04.788815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.799322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:04.800008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:04.800282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:04.810064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:04.811425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] PATH_INFO: `/v3/users/b46b797365d64b2c895c8c5469efe920` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:04.815338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46b797365d64b2c895c8c5469efe920)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:04.824477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:04.961847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda48e9df71b48b6acc5d69637b8f2c2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.968828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46b797365d64b2c895c8c5469efe920'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.983551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda48e9df71b48b6acc5d69637b8f2c2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.987641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda48e9df71b48b6acc5d69637b8f2c2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.987641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda48e9df71b48b6acc5d69637b8f2c2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.993388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46b797365d64b2c895c8c5469efe920'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.994056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46b797365d64b2c895c8c5469efe920'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:04.994693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46b797365d64b2c895c8c5469efe920'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:05.016105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5b27e7eb-fc80-4f9b-b306-6edf40639aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46b797365d64b2c895c8c5469efe920'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:05.042699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:05.056983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda48e9df71b48b6acc5d69637b8f2c2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:05.065677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 845/1691] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:04 2022] DELETE /identity/v3/users/b46b797365d64b2c895c8c5469efe920 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:05.066193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:05.066485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:05.066762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:05.116891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 847/1692] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:04 2022] DELETE /identity/v3/users/cda48e9df71b48b6acc5d69637b8f2c2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:05.122066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:05.123627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:05.248798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 846/1693] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:05.404616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:05.407125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:05.561331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414b39-f747-4adc-8b37-1cf84d5eeaaa admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:05.571579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:05.572219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:05.572498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:05.572769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:05.596931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:05.598401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706ccc4e-a9f4-43e9-a9a1-8f0ed45e939c service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:05.620990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 848/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:07.050697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:07.054212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.089621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9302b13-129b-4883-a2c3-1871ccca44bb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:07.096300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:07.097324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.097791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.098212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] PATH_INFO: `/v3/projects/e7a2c794eef740159e4784d83c319a38` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.099764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a2c794eef740159e4784d83c319a38)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:07.102358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:07.230769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a2c794eef740159e4784d83c319a38', 'request_id': 'req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.253607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a2c794eef740159e4784d83c319a38', 'request_id': 'req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.261573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a2c794eef740159e4784d83c319a38', 'request_id': 'req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.275985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] The token cache is being invalidate because project e7a2c794eef740159e4784d83c319a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:07.276521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.277336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.291442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 847/1695] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:07 2022] DELETE /identity/v3/projects/e7a2c794eef740159e4784d83c319a38 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:07.296767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf138ff-3142-4706-82a4-157ca1f7f223 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.297296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf138ff-3142-4706-82a4-157ca1f7f223 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.297296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf138ff-3142-4706-82a4-157ca1f7f223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.328971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:07.331427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.333784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bcf138ff-3142-4706-82a4-157ca1f7f223 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:07.334981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bcf138ff-3142-4706-82a4-157ca1f7f223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.448107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380c2-b716-42b3-a85e-1bf3b4c5ad85 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:07.462247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:07.463808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.464277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.466599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] PATH_INFO: `/v3/projects/2343945de3244eea88144bd85ab99c2e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.471090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2343945de3244eea88144bd85ab99c2e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:07.476174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:07.506274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 849/1696] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:07.508094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.508385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.511975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.557844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:07.561571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:07.563438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.593271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 850/1697] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:07.598541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:07.631858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988de7-5b4b-43b1-9900-4eea27884147 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:07.658483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2343945de3244eea88144bd85ab99c2e', 'request_id': 'req-b84084af-7cd9-49d5-906b-36d42cfc6d4d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.679125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2343945de3244eea88144bd85ab99c2e', 'request_id': 'req-b84084af-7cd9-49d5-906b-36d42cfc6d4d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.680267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:07.692995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2343945de3244eea88144bd85ab99c2e', 'request_id': 'req-b84084af-7cd9-49d5-906b-36d42cfc6d4d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.714429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] The token cache is being invalidate because project 2343945de3244eea88144bd85ab99c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:07.716806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.718033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:07.721539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 848/1698] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:07 2022] DELETE /identity/v3/projects/2343945de3244eea88144bd85ab99c2e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:07.726587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:07.730750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.803112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:07.804018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.805501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.805937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.808764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:07.809256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:07.811289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77085-f44b-4880-96d5-1f028cd803af admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:07.852323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 851/1699] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:07.852323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.853313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.853591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.856177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84084af-7cd9-49d5-906b-36d42cfc6d4d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:07.862798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:07.863678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:07.864071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:07.864355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] PATH_INFO: `/v3/users/686bd7b132374b47b39b8ddb54047514` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:07.865689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=686bd7b132374b47b39b8ddb54047514)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:07.867665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:07.899010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:07.901620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.929724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 852/1700] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:07.937485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:07.937485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:07.982437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37520692-906f-4fa7-ac0c-febceeeac1f5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.003003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686bd7b132374b47b39b8ddb54047514'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:08.005004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.005164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.005431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.006083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.006735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.009616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4de2a-41e7-4ee1-8bf1-2bb3aaaeb1e6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.016396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686bd7b132374b47b39b8ddb54047514'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:08.018069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686bd7b132374b47b39b8ddb54047514'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:08.020828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686bd7b132374b47b39b8ddb54047514'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:08.060973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686bd7b132374b47b39b8ddb54047514'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:08.085502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 853/1701] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:07 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:08.086775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb8e0-142d-435f-bd6c-ab5dadcaf7a5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.087104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb8e0-142d-435f-bd6c-ab5dadcaf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.087374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fb8e0-142d-435f-bd6c-ab5dadcaf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.103374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 849/1702] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:07 2022] DELETE /identity/v3/users/686bd7b132374b47b39b8ddb54047514 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:08.104519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.106486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:08.148857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-400fb8e0-142d-435f-bd6c-ab5dadcaf7a5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:08.151344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-400fb8e0-142d-435f-bd6c-ab5dadcaf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:08.224127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:08.365279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 854/1703] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:08.366705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.366854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.367367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.391104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb4cc-2c81-42d1-bc10-2d19e1288fec admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.406405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.407054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.407340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.407773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.408433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.415149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.423293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:08.424940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:08.452323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 855/1704] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:08.465658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 850/1705] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:08.466909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.469877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.486899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc8300-ffc4-40fe-a8bc-f2bb3f182bac None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.492110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.493026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.494075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.494520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.495359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:08.495972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.500765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.507578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1168d-a24f-4825-b3ff-aba116c2175f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.534441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.535100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.535409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.542135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.546495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.548473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 856/1706] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:08.552818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.566567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.577358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c2b5-1b01-45ed-b464-91097927e7b8 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.586806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.588336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.588911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.589567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.592208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.597146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.621878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 851/1707] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:08.623442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.638811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:08.658884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 857/1708] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:08.660982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.727913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:08.754477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d1ea-1fd3-4222-bfe7-37a54736769d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.762866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.764774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.765215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.765619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.767097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.769289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.793190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 858/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:08.795259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.807794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51760f9b-71a1-4e11-9519-ceda3dbdcebc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.819045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.819954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.820319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.820804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.820913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec144d8-4136-44e8-934c-b3fe53b56ca7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.821760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.824184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.865212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 859/1710] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/users => generated 285 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:08.866453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:08.902942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a554de6-e336-499b-8e9c-06fac71aae1c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:08.916624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:08.917494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.917772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.918194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] PATH_INFO: `/v3/projects/81d1c3c3525e4f108bd54185c3767a80/users/484002ed97a845e7b36394a564f95ed3/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:08.957343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d1c3c3525e4f108bd54185c3767a80, user_id=484002ed97a845e7b36394a564f95ed3, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:08.969672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfab4bb-2767-40c5-a2d8-b2d5e9ac30ed admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:08.992775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 860/1711] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:08 2022] PUT /identity/v3/projects/81d1c3c3525e4f108bd54185c3767a80/users/484002ed97a845e7b36394a564f95ed3/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:08.994391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ea42-7313-440c-961f-dabd7d6232c0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:08.994666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ea42-7313-440c-961f-dabd7d6232c0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:08.994945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348ea42-7313-440c-961f-dabd7d6232c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.039053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0348ea42-7313-440c-961f-dabd7d6232c0 None None] MFA Rules not processed for user `809fcd4bc90440539af13ea0d1c8cb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:09.040619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.041261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.041526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.041799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.043073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0348ea42-7313-440c-961f-dabd7d6232c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.064572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.066042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.102513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 852/1712] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:09.103709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.130700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110f5ca-39a9-4714-b20b-adc444495ad7 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:09.149089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 861/1713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:09.157281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.157281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.157281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.196474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] MFA Rules not processed for user `484002ed97a845e7b36394a564f95ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:09.197717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.363201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 862/1714] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:09.363201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.363201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.364196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.364827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.365107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.365805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.366190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.367921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.384475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da3c7e-549c-4698-9c76-34787ed3118d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:09.397088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:09.405326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.406284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.406590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.406889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] PATH_INFO: `/v3/users/c1955b973ae84af6940a8b1f139fa639` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.408720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1955b973ae84af6940a8b1f139fa639)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.410705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.423396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 853/1715] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:09.427665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.436236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.462241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:09.586807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1955b973ae84af6940a8b1f139fa639'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:09.619604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1955b973ae84af6940a8b1f139fa639'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:09.620784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1955b973ae84af6940a8b1f139fa639'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:09.621624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1955b973ae84af6940a8b1f139fa639'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:09.641833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1955b973ae84af6940a8b1f139fa639'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:09.648615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e2a81-434e-4b94-be61-295a6a02627d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:09.662296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 863/1716] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:09 2022] DELETE /identity/v3/users/c1955b973ae84af6940a8b1f139fa639 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:09.663921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.665511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.669145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.669831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.670113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.670389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.676036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.718576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.720214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.760610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 854/1717] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:09.767321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2db898-cb8b-48a7-9efb-28b016be6b84 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:09.774180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.775012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.775278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.775754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.776215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.777094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.780355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dffa35-42be-4014-a51e-24306caa4f3a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.781159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.836613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523d6fb-18cc-4141-801d-3961594edde0 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:09.839784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 864/1718] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:09 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:09.843302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.843802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.844234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.859519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:09.860156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:09.860434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:09.860705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:09.861357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:09.874080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:09.897302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:09.898820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:09.920191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 855/1719] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:09.921674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:09.968574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02151d2-e7c0-4ed1-9093-d7c0bb0f8acc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.050884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 865/1720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:10.055841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.068856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32f026-e6b7-464f-b0d5-b6b6b075c057 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.079844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d775e-687a-455e-9e14-525687224936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.080722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d775e-687a-455e-9e14-525687224936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.081048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d775e-687a-455e-9e14-525687224936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.081332 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d775e-687a-455e-9e14-525687224936 admin admin] PATH_INFO: `/v3/projects/4b186219f70e4ac08b185b44d564a934/users/d27e5ba80f4043b193007c8b297aa39b/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.099913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:10.105627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d775e-687a-455e-9e14-525687224936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b186219f70e4ac08b185b44d564a934, user_id=d27e5ba80f4043b193007c8b297aa39b, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.111862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d775e-687a-455e-9e14-525687224936 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.152165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 866/1721] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:10 2022] PUT /identity/v3/projects/4b186219f70e4ac08b185b44d564a934/users/d27e5ba80f4043b193007c8b297aa39b/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:10.155058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.155348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.155650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.186360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.188067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.188349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.188620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.190440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.196418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.229454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] MFA Rules not processed for user `d27e5ba80f4043b193007c8b297aa39b`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:10.230691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:10.246525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 856/1722] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:09 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:10.250876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.270777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5dfd4-2d08-4537-a2c9-97acb2a161f6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.442674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.443274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.443581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.444200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.446367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.450120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.455994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 867/1723] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:10.457216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.465136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:10.479817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 857/1724] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:10.483912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.490923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac75d9-6a3f-4b07-8be8-98595f5d7165 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.506845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.507567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.507940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.508061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.508917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.510589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.512915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adb83a-23a7-4d7a-be55-20699908446b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.550836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.551592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.551873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.552151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] PATH_INFO: `/v3/projects/a4e74a700251442eb68b434828c00db3/users/048e1b80533f42aa830afe0dc6fe821a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.591701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 868/1725] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:10 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:10.591701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.592125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e74a700251442eb68b434828c00db3, user_id=048e1b80533f42aa830afe0dc6fe821a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.593039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:10.602215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.657444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 858/1726] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:10 2022] PUT /identity/v3/projects/a4e74a700251442eb68b434828c00db3/users/048e1b80533f42aa830afe0dc6fe821a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:10.659874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.719932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba8bf5-30ef-49a9-9cf2-c61b49a84abd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.801846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d935-5b3a-4175-9b1f-5bb25b039d35 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.816021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.816670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.816800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.817070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.817708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.821612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.835352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.836151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.836573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.836729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.855234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.861339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.880188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 859/1727] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:10 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:10.883267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.906537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 869/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:10.907559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:10.910517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0357-e802-4938-818e-7cebc1e76b38 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.941484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9738ec-fe08-4cc3-b540-98768a8f12d7 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:10.941639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.942178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.942288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.942612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.943337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.945037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.958538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:10.959233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:10.959602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:10.959937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:10.960923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:10.962582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:10.977081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 860/1729] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:10.983322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.002970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 870/1730] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:11.009287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.011709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18319-bb8e-4771-a971-f1ed1edd6204 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.030503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.032521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.033055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.035381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2912e-0dd9-4ce7-a105-7cf718cbe072 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.035768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] PATH_INFO: `/v3/projects/a4e74a700251442eb68b434828c00db3/users/048e1b80533f42aa830afe0dc6fe821a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.040591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e74a700251442eb68b434828c00db3, user_id=048e1b80533f42aa830afe0dc6fe821a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.043347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab17cc-94d8-4cea-ab67-cba594d842c9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.057276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.058048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.059334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.061263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] PATH_INFO: `/v3/projects/0606a9aabeef47c38e45be3ece0077b1/users/2ce62d09bc4041b6bfb8368a5a8ca1ec/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.068603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:11.088342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 861/1731] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:10 2022] PUT /identity/v3/projects/a4e74a700251442eb68b434828c00db3/users/048e1b80533f42aa830afe0dc6fe821a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:11.098628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.099213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.099720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.127699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606a9aabeef47c38e45be3ece0077b1, user_id=2ce62d09bc4041b6bfb8368a5a8ca1ec, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.135889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.191769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] MFA Rules not processed for user `048e1b80533f42aa830afe0dc6fe821a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:11.192673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 871/1732] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:11 2022] PUT /identity/v3/projects/0606a9aabeef47c38e45be3ece0077b1/users/2ce62d09bc4041b6bfb8368a5a8ca1ec/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:11.194821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:11.196326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.343723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 862/1733] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:11.364532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.369587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:11.390391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa7d7a-3d2f-46ae-94c6-4d801c522db8 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.405054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.405894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.406230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.406603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.410266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.413624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.440151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 872/1734] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:11.442308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.471155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:11.475330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17977-9369-4b22-8fa9-d333ffca4757 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.517395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.518268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.518620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.518988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] PATH_INFO: `/v3/projects/0606a9aabeef47c38e45be3ece0077b1/users/2ce62d09bc4041b6bfb8368a5a8ca1ec/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.529516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606a9aabeef47c38e45be3ece0077b1, user_id=2ce62d09bc4041b6bfb8368a5a8ca1ec, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.537715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a339d6-6e53-4ca5-8ae5-aeb2e520817b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.545093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564ea24-dd28-4140-b8fc-3f159822b257 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.571927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 873/1735] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:11 2022] PUT /identity/v3/projects/0606a9aabeef47c38e45be3ece0077b1/users/2ce62d09bc4041b6bfb8368a5a8ca1ec/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:11.576234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.576731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.577101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.654182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] MFA Rules not processed for user `2ce62d09bc4041b6bfb8368a5a8ca1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:11.655827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:11.690734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.693634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.695951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.697317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.854335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 874/1736] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:11.868486 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:11.872660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:11.878521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.880063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.892387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac760c-412c-42ba-bcf2-b4f637cf519e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:11.900303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:11.901231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:11.901685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:11.902055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:11.912839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 863/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:11.946033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:11.947662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:11.979317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 875/1738] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:12.020896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:12.022407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.111069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:12.125845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a606d-5cbf-48e3-8687-1296e6f8a05e service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:12.164754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:12.167852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.168264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.173233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.176175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.207055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b8086-2e29-4767-b33c-8fd8db39d3c0 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:12.224098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:12.224829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.225206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.225543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] PATH_INFO: `/v3/projects/f887e580275648c080a249f6714a5058` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.226933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f887e580275648c080a249f6714a5058)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:12.229986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:12.265523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:12.329620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:12.351584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f887e580275648c080a249f6714a5058', 'request_id': 'req-04e4f3bb-116d-47d8-8ecd-83785be68652'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:12.363818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f887e580275648c080a249f6714a5058', 'request_id': 'req-04e4f3bb-116d-47d8-8ecd-83785be68652'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:12.373097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f887e580275648c080a249f6714a5058', 'request_id': 'req-04e4f3bb-116d-47d8-8ecd-83785be68652'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:12.379341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:12.384884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae155-370c-4958-85c8-c42b87a8dc92 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:12.398892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] The token cache is being invalidate because project f887e580275648c080a249f6714a5058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:12.399446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:12.400389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:12.403138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 864/1739] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:12 2022] DELETE /identity/v3/projects/f887e580275648c080a249f6714a5058 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:12.405531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:12.418798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.433952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 876/1740] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:12.442902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375646-8d72-4802-bbde-937959d15017 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.444716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375646-8d72-4802-bbde-937959d15017 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.445251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375646-8d72-4802-bbde-937959d15017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.565694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e3375646-8d72-4802-bbde-937959d15017 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:12.576893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e3375646-8d72-4802-bbde-937959d15017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.630655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4f3bb-116d-47d8-8ecd-83785be68652 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:12.647826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:12.648468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.648788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.649051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.651238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.820755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:12.822215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:12.823175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 877/1741] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:12.833059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.833342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.833674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.878697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 865/1742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:12.902072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:12.905764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:12.932786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 878/1743] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:12.934065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:12.955034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659b4f8-bc65-4259-993f-e7812d6d69fa service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:12.963110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:12.963683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:12.964205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:12.964427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:12.965305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:12.965783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:12.968199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.002229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 866/1744] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:13.005846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:13.018108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957373f-fbdb-4f31-b10d-f904109a6de5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:13.036548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:13.037358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.037633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.039532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.042548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:13.048783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.143645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:13.146666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 879/1745] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:13 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:13.159287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39fe626-1747-4939-ae7e-643ed89cc30b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:13.386724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:13.387344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.387712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.389590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.390272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:13.394007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.422285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:13.477772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:13.502084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 867/1746] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:13 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:13.515131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2807bb2-5929-47ab-90f6-559ffa7038f3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:13.542264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:13.543553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.544049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.544387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.545382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:13.547215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.582313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:13.592888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 880/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:13.593588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8143f-7749-4a12-bcdb-b767a280f072 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:13.610638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:13.611266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.611684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.611929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.612577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:13.614548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e39e7-62c2-42eb-9e36-f748eef74797 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.649150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:13.660617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 868/1748] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:13.665968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448c495-c026-4129-9f47-aaaba89b7166 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:13.684146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:13.685381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.685783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.686193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] PATH_INFO: `/v3/projects/6711afc71e39453ea1a88916cc5450fe/users/a2d368bd99e9457b9ad6adb0cd35435a/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.716450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6711afc71e39453ea1a88916cc5450fe, user_id=a2d368bd99e9457b9ad6adb0cd35435a, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:13.721237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27315b36-45ce-4451-a86c-6f27b8e8b1ed admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:13.763530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.764499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.764785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.767496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 881/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:13 2022] PUT /identity/v3/projects/6711afc71e39453ea1a88916cc5450fe/users/a2d368bd99e9457b9ad6adb0cd35435a/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:13.851666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] MFA Rules not processed for user `a2d368bd99e9457b9ad6adb0cd35435a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:13.854102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:13.920228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:13.920674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:13.920949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:13.984552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] MFA Rules not processed for user `09278399bc0148e68f0c7204fe19dc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:13.987721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:14.049645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 869/1750] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:14.050523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:14.156233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 882/1751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:14.187446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:14.189613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:14.198426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:14.209786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb36876-f9c7-48ef-ba5f-7f92db099fae None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:14.227104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:14.228096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:14.228517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:14.228930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:14.229741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:14.232543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:14.320029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 870/1752] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:14 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:14.320029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:14.323701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:14.375490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93bb75-119e-4c7a-a627-9699c0533fc6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:14.520833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:14.524600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:14.524973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:14.525295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:14.539352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:14.551504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb13a-ef57-4e10-89cf-bb8b595e9429 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:14.552427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:14.553437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:14.553835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:14.554387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] PATH_INFO: `/v3/projects/242cccfeda7c466d93337dddbedf03b4` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:14.556079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=242cccfeda7c466d93337dddbedf03b4)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:14.560533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:14.658027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:14.660368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:14.675717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242cccfeda7c466d93337dddbedf03b4', 'request_id': 'req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:14.677336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 883/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:14.678617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:14.693640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96956621-f936-4f3c-bb30-de95173c79c8 service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:14.719121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242cccfeda7c466d93337dddbedf03b4', 'request_id': 'req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:14.735767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242cccfeda7c466d93337dddbedf03b4', 'request_id': 'req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:14.789871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] The token cache is being invalidate because project 242cccfeda7c466d93337dddbedf03b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:14.790171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:14.792386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ab02c4d1-9388-4cd4-a8d4-d216fed13f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:14.813256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 871/1754] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:14 2022] DELETE /identity/v3/projects/242cccfeda7c466d93337dddbedf03b4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:14.818274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:14.818559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:14.818834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:14.820184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:14.928394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] MFA Rules not processed for user `7a8a52a175954db1bab6545353bb878d`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:14.929739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:14.945164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:14.946703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:14.949497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:14.951890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:14.952685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:14.964488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.052011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 884/1755] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:14 2022] POST /identity/v3/users => generated 292 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:15.057472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.064987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.096536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5843-20d3-4f82-b4cb-2280ff246a62 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.119416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 872/1756] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:15.119640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.119640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.119826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.119963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.119963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] PATH_INFO: `/v3/users/36c56c73fdf648e7b5ba04a27d5ded91` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.119963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c56c73fdf648e7b5ba04a27d5ded91)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.120192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.121282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.159326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e742b9-f442-4ac6-917e-eecc0c98b987 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.170386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.171454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.171943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.172462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.173270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.178502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72d0ae-3414-46de-91c0-1c80a9bcd1f3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.202360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 873/1757] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:15.206469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.207071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.207548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.231816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] MFA Rules not processed for user `7a8a52a175954db1bab6545353bb878d`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:15.233466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.234051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c56c73fdf648e7b5ba04a27d5ded91'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:15.245489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 874/1758] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:15.246745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.259411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c56c73fdf648e7b5ba04a27d5ded91'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:15.260511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c56c73fdf648e7b5ba04a27d5ded91'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:15.262780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c56c73fdf648e7b5ba04a27d5ded91'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:15.284790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1609f7-905d-4ed7-b218-c9770a2e3ba0 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.302268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.303344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.303527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.303811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] PATH_INFO: `/v3/projects/88858d7eacf943b0af34409369f82e4e/users/92a09118d4a54e47a67ec6cea2ff52ff/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.311690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c56c73fdf648e7b5ba04a27d5ded91'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:15.347146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 885/1759] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:15 2022] DELETE /identity/v3/users/36c56c73fdf648e7b5ba04a27d5ded91 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:15.348985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.353461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.361944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88858d7eacf943b0af34409369f82e4e, user_id=92a09118d4a54e47a67ec6cea2ff52ff, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.366783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.399345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 875/1760] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:15 2022] PUT /identity/v3/projects/88858d7eacf943b0af34409369f82e4e/users/92a09118d4a54e47a67ec6cea2ff52ff/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:15.406629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.413137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.526573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:15.589203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba31557-fd6f-4aa8-b79c-4f59cb905f70 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.607445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95772ff3-f50c-48a1-9085-620e43c158f0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.627052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.628467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.628756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.629032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.630342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.636955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.685638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 876/1761] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:15.688855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:15.696677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:15.713753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e95d6-9cbe-4b31-b570-8cd471910ea6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:15.729580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.731001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.731001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.733556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] PATH_INFO: `/v3/projects/88858d7eacf943b0af34409369f82e4e/users/92a09118d4a54e47a67ec6cea2ff52ff/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.738153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88858d7eacf943b0af34409369f82e4e, user_id=92a09118d4a54e47a67ec6cea2ff52ff, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.745016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a559f4-98f2-48fc-9dc9-fb9d2fa0bcf3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.769997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:15.771987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.772387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.783045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 877/1762] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:15 2022] PUT /identity/v3/projects/88858d7eacf943b0af34409369f82e4e/users/92a09118d4a54e47a67ec6cea2ff52ff/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:15.783045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27e77-c21a-443c-99ee-2f7ab5dd2935 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.783045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27e77-c21a-443c-99ee-2f7ab5dd2935 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.783385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.783496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27e77-c21a-443c-99ee-2f7ab5dd2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:15.783589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.871088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-11c27e77-c21a-443c-99ee-2f7ab5dd2935 None None] MFA Rules not processed for user `db51c324fddc472c871b077167c903e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:15.872726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-11c27e77-c21a-443c-99ee-2f7ab5dd2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:15.946958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:15.948945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422a082-3000-4bd6-9891-cf721a7a53e0 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:15.975838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 886/1763] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:15.978866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cca85-5117-465d-8f50-1f2804612829 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:15.979151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cca85-5117-465d-8f50-1f2804612829 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:15.982041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cca85-5117-465d-8f50-1f2804612829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.073223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-701cca85-5117-465d-8f50-1f2804612829 None None] MFA Rules not processed for user `92a09118d4a54e47a67ec6cea2ff52ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:16.078050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-701cca85-5117-465d-8f50-1f2804612829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.101779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 878/1764] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:16.112430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddc87-5632-4e88-ada5-2539bdfb614e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.112929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddc87-5632-4e88-ada5-2539bdfb614e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.113449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ddc87-5632-4e88-ada5-2539bdfb614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.171904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-c65ddc87-5632-4e88-ada5-2539bdfb614e None None] MFA Rules not processed for user `db51c324fddc472c871b077167c903e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:16.175233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c65ddc87-5632-4e88-ada5-2539bdfb614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.211361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 879/1765] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:16.213202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.213486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.213759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.264680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] MFA Rules not processed for user `809fcd4bc90440539af13ea0d1c8cb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:16.268994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.280655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 887/1766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:16.285021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cca85-5117-465d-8f50-1f2804612829 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:16.294891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-701cca85-5117-465d-8f50-1f2804612829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.487639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 880/1767] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:16.489139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:16.495347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:16.497851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:16.542212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cca85-5117-465d-8f50-1f2804612829 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:16.567457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:16.568123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.568509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.572151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.599358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:16.604501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3913db-d953-4bec-89e5-eeca2dd165b8 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:16.647479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 888/1768] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:16.678917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:16.688823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb244bc-f605-4aca-90df-f352f12e2794 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:16.702975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:16.704782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:16.705155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:16.705544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:16.726413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:16.728192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125519-cd4c-48ef-81b9-10b9154e94c1 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:16.747182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 881/1769] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:17.300588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.301092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.301179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.302625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 889/1770] 10.222.0.18 () {54 vars in 912 bytes} [Wed Sep 7 13:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:17.313014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.313304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.313608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.334885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:17.337032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:17.483447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:17.484767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:17.608448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f06f9-0fea-4394-b7ba-e4259de44d2f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:17.628195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:17.628857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.629134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.629402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] PATH_INFO: `/v3/projects/3106291ea1ae495b8296ec98968c0801` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.631324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3106291ea1ae495b8296ec98968c0801)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:17.633437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:17.652313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 882/1771] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:17.694194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:17.695845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:17.714775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7f02a-20a9-4548-a910-2b65fe6aa7d7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:17.733596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:17.734584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.734864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.735153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.756870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:17.760794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:17.781527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 883/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:17.786548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3106291ea1ae495b8296ec98968c0801', 'request_id': 'req-f747da7c-5505-4a5f-bb98-1fba084f1fc5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:17.794693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:17.813410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3106291ea1ae495b8296ec98968c0801', 'request_id': 'req-f747da7c-5505-4a5f-bb98-1fba084f1fc5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:17.829315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b4356-fe42-49dc-af0f-5c0d860c3d3c service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:17.831730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3106291ea1ae495b8296ec98968c0801', 'request_id': 'req-f747da7c-5505-4a5f-bb98-1fba084f1fc5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:17.862573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] The token cache is being invalidate because project 3106291ea1ae495b8296ec98968c0801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:17.862728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:17.867354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f747da7c-5505-4a5f-bb98-1fba084f1fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:17.874890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 890/1773] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:17 2022] DELETE /identity/v3/projects/3106291ea1ae495b8296ec98968c0801 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:17.876326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834da15-ffe5-4bc4-9cb4-0570ea605051 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.876614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834da15-ffe5-4bc4-9cb4-0570ea605051 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.877200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834da15-ffe5-4bc4-9cb4-0570ea605051 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.881151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 891/1774] 10.222.0.18 () {54 vars in 912 bytes} [Wed Sep 7 13:06:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:17.882378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a0b-46fb-4429-8730-886b0ea3d1a6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:17.882665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a0b-46fb-4429-8730-886b0ea3d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:17.882943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4a0b-46fb-4429-8730-886b0ea3d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:17.947391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5cba4a0b-46fb-4429-8730-886b0ea3d1a6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:17.950072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5cba4a0b-46fb-4429-8730-886b0ea3d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.000262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.000946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.001230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.001508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] PATH_INFO: `/v3/users/a2d368bd99e9457b9ad6adb0cd35435a` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.018706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d368bd99e9457b9ad6adb0cd35435a)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:18.024761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:18.160661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 892/1775] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:18.162299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21c14-100e-4339-9c5d-6edb411b8ba5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.162918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21c14-100e-4339-9c5d-6edb411b8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.165015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21c14-100e-4339-9c5d-6edb411b8ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.190127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d368bd99e9457b9ad6adb0cd35435a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.212547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d368bd99e9457b9ad6adb0cd35435a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.213277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d368bd99e9457b9ad6adb0cd35435a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.214061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d368bd99e9457b9ad6adb0cd35435a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.227962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-08d21c14-100e-4339-9c5d-6edb411b8ba5 None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:18.232110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-08d21c14-100e-4339-9c5d-6edb411b8ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.238428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-ebbc3977-0d80-4bb2-87da-741b00571ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d368bd99e9457b9ad6adb0cd35435a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.256067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:18.274652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:18.319619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 884/1776] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:17 2022] DELETE /identity/v3/users/a2d368bd99e9457b9ad6adb0cd35435a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:18.321395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.321886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.322368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.377013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:18.379414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.381403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 893/1777] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:18.383755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.384338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.384414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.414572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:18.415901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.540912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 885/1778] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:18.542424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:18.546403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.573987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 894/1779] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:18.575826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:18.581736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.584450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d0c43-9c5e-4ca8-a865-6f81bd2e08fd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:18.590968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.591989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.592447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.592869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] PATH_INFO: `/v3/users/d27e5ba80f4043b193007c8b297aa39b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.594261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d27e5ba80f4043b193007c8b297aa39b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:18.596472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:18.703542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd27e5ba80f4043b193007c8b297aa39b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.722387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd27e5ba80f4043b193007c8b297aa39b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.723729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd27e5ba80f4043b193007c8b297aa39b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.725557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd27e5ba80f4043b193007c8b297aa39b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.737645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da344-17f3-4ce7-a6f2-acafe845080a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:18.744005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd27e5ba80f4043b193007c8b297aa39b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:18.756248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.756889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.757165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.757441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.760435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.777254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:18.781071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:18.805872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 886/1780] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:18 2022] DELETE /identity/v3/users/d27e5ba80f4043b193007c8b297aa39b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:18.807308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:18.810395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 895/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:18.811421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.812382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:18.820647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.843197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15212a-58f2-41f0-acdb-1d3621e2147d service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:18.962017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.963852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.964283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.971948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.977802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:18.980359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea2a0-6bc8-4a6c-818f-1a2af6b6880b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:18.992930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:18.996252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:18.996646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:18.997092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:18.998075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:18.999767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.001602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.006941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.009425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1ca38-f1f0-4089-9574-a928444a4609 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.018732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:19.034709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 896/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:19.036215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.036848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.037205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.040281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 887/1783] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:19.044602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.048445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:19.072166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:19.073621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:19.094250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 897/1784] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:19.102441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.121950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:19.137070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b51ff-49d6-4779-af54-858f6e822e76 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.151854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.152719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.158134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.158694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.159532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.167297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.227087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a8a7-bde0-4fac-b19f-f0bb3e9ff9ec admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.234075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.234806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.235097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.235916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.239973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 898/1785] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:19 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:19.245520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.253683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:19.301487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.306224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.326871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 888/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:19.330001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.342460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196da523-1611-4269-a7c8-33f5c8a54816 service placement] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.424372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd0464-869c-4386-87dc-19159bf77e21 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.432432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.433061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.433340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.433615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.434835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.437934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.439446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.440150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.440431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.440706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.463937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.465146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.495853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 899/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:19.500143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 889/1788] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:19 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:19.504613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.572143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009329-38ed-4f92-bacf-9264a6fbf115 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.584212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.584913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.585266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.585635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.586335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.592246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.613982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 900/1789] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:19.618306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.658751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fe8e6-6f7a-4375-9e65-1ef60343fc96 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.681156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.683333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.683753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.684107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.686666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.688929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.733999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.734317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 890/1790] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:19.751347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230a436-f287-4054-b43d-07a5e38baedc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.775501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:19.776537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.776886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.777231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] PATH_INFO: `/v3/projects/30a90124d24d401a8b96af46e6ba93d7/users/81cbdeb679ee4092bac7e251f2d95878/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.844417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a90124d24d401a8b96af46e6ba93d7, user_id=81cbdeb679ee4092bac7e251f2d95878, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:19.853299 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d8925-5487-47cc-82fc-39fd55c9b99b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:19.894680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:19.897606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:19.901329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 901/1791] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:19 2022] PUT /identity/v3/projects/30a90124d24d401a8b96af46e6ba93d7/users/81cbdeb679ee4092bac7e251f2d95878/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:19.912560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fe50-5906-4d03-b618-e9eb595696ee None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:19.914005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fe50-5906-4d03-b618-e9eb595696ee None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:19.914005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86fe50-5906-4d03-b618-e9eb595696ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:19.933514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3eacf-5bd6-4d54-b98f-a4dcd2a1ceea admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:19.999183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3b86fe50-5906-4d03-b618-e9eb595696ee None None] MFA Rules not processed for user `81cbdeb679ee4092bac7e251f2d95878`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:20.003556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3b86fe50-5906-4d03-b618-e9eb595696ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:20.162751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:20.167284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:20.171749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:20.175887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] PATH_INFO: `/v3/projects/6711afc71e39453ea1a88916cc5450fe` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:20.182679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6711afc71e39453ea1a88916cc5450fe)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:20.195345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:20.265725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:20.408326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 902/1792] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:20.416415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:20.417130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:20.422928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:20.459854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6711afc71e39453ea1a88916cc5450fe', 'request_id': 'req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.480262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6711afc71e39453ea1a88916cc5450fe', 'request_id': 'req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.498044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6711afc71e39453ea1a88916cc5450fe', 'request_id': 'req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.500827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] MFA Rules not processed for user `7a8a52a175954db1bab6545353bb878d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:20.503679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:20.541543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] The token cache is being invalidate because project 6711afc71e39453ea1a88916cc5450fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:20.544697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.546425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.552529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 891/1793] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:19 2022] DELETE /identity/v3/projects/6711afc71e39453ea1a88916cc5450fe => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:20.553545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:20.555487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:20.646974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:20.690746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 903/1794] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:20.692007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:20.694328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:20.708246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d6ed0-3ef1-46d9-81bb-7d3e05a59ff4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:20.714503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:20.725004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:20.730287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:20.730864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:20.733150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:20.735449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0820f-e127-4d59-919a-cd1029284ef1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:20.777291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d211-2419-4630-bb41-34bec8e82e6f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:20.799226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 892/1795] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:20 2022] POST /identity/v3/projects => generated 393 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:20.800661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:20.801859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:20.802633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:20.802985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:20.803718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] PATH_INFO: `/v3/users/92a09118d4a54e47a67ec6cea2ff52ff` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:20.804202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:20.806087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:20.809538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a09118d4a54e47a67ec6cea2ff52ff)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:20.814362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:20.854678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] MFA Rules not processed for user `09278399bc0148e68f0c7204fe19dc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:20.860314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:20.969377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a09118d4a54e47a67ec6cea2ff52ff'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.996258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a09118d4a54e47a67ec6cea2ff52ff'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.997261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a09118d4a54e47a67ec6cea2ff52ff'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:20.998417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a09118d4a54e47a67ec6cea2ff52ff'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:21.056280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a09118d4a54e47a67ec6cea2ff52ff'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:21.159648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 893/1796] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:21.167077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 904/1797] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:20 2022] DELETE /identity/v3/users/92a09118d4a54e47a67ec6cea2ff52ff => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:21.169247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:21.171873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:21.176927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:21.183132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:21.233788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:21.413500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6507dc-a89b-4189-a6af-15d0c563162a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:21.631767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c5566-271b-4bbd-b203-51f258bac260 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:21.688941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:21.689883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:21.690338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:21.690766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:21.692172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:21.692473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:21.692834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:21.693150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:21.693373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] PATH_INFO: `/v3/projects/4b186219f70e4ac08b185b44d564a934` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:21.699367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b186219f70e4ac08b185b44d564a934)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:21.701135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:21.701770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:21.809124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 905/1798] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:21 2022] POST /identity/v3/users => generated 303 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:21.813717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:21.861229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81613e20-6d2d-4671-aed2-7db4f471754e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:21.883219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:21.885792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:21.888162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:21.892834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:21.896354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:21.909721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:21.950814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 906/1799] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:21.956953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:21.976366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b186219f70e4ac08b185b44d564a934', 'request_id': 'req-9582dd5b-7766-4d3f-b141-0eced3d8e14b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.015366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b186219f70e4ac08b185b44d564a934', 'request_id': 'req-9582dd5b-7766-4d3f-b141-0eced3d8e14b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.019245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fc44-fe26-4faa-9ce1-fac0bbb3678b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:22.032402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b186219f70e4ac08b185b44d564a934', 'request_id': 'req-9582dd5b-7766-4d3f-b141-0eced3d8e14b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.081447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] The token cache is being invalidate because project 4b186219f70e4ac08b185b44d564a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:22.081892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.083156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.091396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 894/1800] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:21 2022] DELETE /identity/v3/projects/4b186219f70e4ac08b185b44d564a934 => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:22.092828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:22.094321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:22.156458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:22.230110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:22.232738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.232882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.233217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] PATH_INFO: `/v3/projects/3262f281af64449e9f3d54b94f831019/users/c318929123684b60b0206db6ff57d73a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.299487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3262f281af64449e9f3d54b94f831019, user_id=c318929123684b60b0206db6ff57d73a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:22.318956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:22.321129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582dd5b-7766-4d3f-b141-0eced3d8e14b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:22.335326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:22.337578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.346464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.351201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] PATH_INFO: `/v3/users/2ce62d09bc4041b6bfb8368a5a8ca1ec` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.355852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 907/1801] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:21 2022] PUT /identity/v3/projects/3262f281af64449e9f3d54b94f831019/users/c318929123684b60b0206db6ff57d73a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:22.358686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:22.359613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce62d09bc4041b6bfb8368a5a8ca1ec)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:22.363568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:22.377992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:22.411342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:22.526364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce62d09bc4041b6bfb8368a5a8ca1ec'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.546886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce62d09bc4041b6bfb8368a5a8ca1ec'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.547674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce62d09bc4041b6bfb8368a5a8ca1ec'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.549805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce62d09bc4041b6bfb8368a5a8ca1ec'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.568444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d771-c2c4-4bd3-bae6-ec3367b55fb7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:22.589512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce62d09bc4041b6bfb8368a5a8ca1ec'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:22.592821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:22.595274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.596653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.596977 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.598054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:22.604432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:22.636819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 908/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:22.638734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:22.642005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 895/1803] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:22 2022] DELETE /identity/v3/users/2ce62d09bc4041b6bfb8368a5a8ca1ec => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:22.643829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:22.689114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7db-e05b-4e5d-a9ef-5e171c78fbe1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:22.874956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:22.879021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.879326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.879968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] PATH_INFO: `/v3/projects/3262f281af64449e9f3d54b94f831019/users/c318929123684b60b0206db6ff57d73a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.884275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3262f281af64449e9f3d54b94f831019, user_id=c318929123684b60b0206db6ff57d73a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:22.891133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff627c-7912-4893-b780-ea05b782c1c8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:22.918367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:22.920625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:22.955848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 909/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:22 2022] PUT /identity/v3/projects/3262f281af64449e9f3d54b94f831019/users/c318929123684b60b0206db6ff57d73a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:22.962334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:22.962659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:22.962887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:22.983060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1949-71a1-4338-83da-71c21028cc97 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:23.088616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] MFA Rules not processed for user `c318929123684b60b0206db6ff57d73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:23.091666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.229777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:23.268992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:23.269809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:23.270105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:23.270491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] PATH_INFO: `/v3/projects/88858d7eacf943b0af34409369f82e4e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:23.273280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88858d7eacf943b0af34409369f82e4e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:23.280911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:23.281464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 910/1805] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:23.294613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:23.297968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.427179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88858d7eacf943b0af34409369f82e4e', 'request_id': 'req-8c56e377-fe8e-4546-9dc3-678439a91ae0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:23.444082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88858d7eacf943b0af34409369f82e4e', 'request_id': 'req-8c56e377-fe8e-4546-9dc3-678439a91ae0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:23.472328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88858d7eacf943b0af34409369f82e4e', 'request_id': 'req-8c56e377-fe8e-4546-9dc3-678439a91ae0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:23.489191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03d20f-b7b1-469e-9eac-2ab7db674fc7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:23.534847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] The token cache is being invalidate because project 88858d7eacf943b0af34409369f82e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:23.540078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:23.541760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c56e377-fe8e-4546-9dc3-678439a91ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:23.546675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 896/1806] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:22 2022] DELETE /identity/v3/projects/88858d7eacf943b0af34409369f82e4e => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:23.551273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055971-535e-458a-9e08-dc73c12915fe None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:23.551749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055971-535e-458a-9e08-dc73c12915fe None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:23.552343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055971-535e-458a-9e08-dc73c12915fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:23.615026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b3055971-535e-458a-9e08-dc73c12915fe None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:23.618347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b3055971-535e-458a-9e08-dc73c12915fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.625665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:23.626556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:23.627124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:23.627889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:23.630630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.644249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:23.851032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 897/1807] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:23.859658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:23.864192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:23.864477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:23.939347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:23.940641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:23.986713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 898/1808] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:23.988315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.011604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.016779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.051844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 911/1809] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:24.057751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d6faf-539d-421a-807e-bb52dc6cba0f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.066479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:24.067594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.068062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.068566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.069395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:24.069950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.071975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.096176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 899/1810] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:24.100576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.119133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdef474-038e-44c9-a900-888337b12091 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.125817 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:24.126677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.127324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.128657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.129536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.132118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.165622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.168234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:24.181024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 912/1811] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:24 2022] POST /identity/v3/projects => generated 409 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:24.185816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.194156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc187d-d006-480f-9a6d-9690efcc3b5c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.228484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:24.303098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7883e-d6cc-4a69-b3d7-80328cbdcf8e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.310661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:24.311626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.311981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.313012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.313744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.315854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.337006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:24.337696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.339820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.340241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.343606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:24.365471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 913/1812] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:24 2022] POST /identity/v3/users => generated 305 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:24.366374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.370290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:24.418741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34874b21-3aec-4ac5-9dc0-b4c378441642 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.437665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:24.446880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.447254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.447570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] PATH_INFO: `/v3/projects/0606a9aabeef47c38e45be3ece0077b1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.452289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0606a9aabeef47c38e45be3ece0077b1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.456028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.495683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:24.500412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:24.552845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 900/1813] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:24.553938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:24.636597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254720b9-f065-460d-8f30-e58081018e86 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:24.649753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0606a9aabeef47c38e45be3ece0077b1', 'request_id': 'req-f7e09d01-05ec-4ec0-a137-32d9b1056d11'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:24.693745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0606a9aabeef47c38e45be3ece0077b1', 'request_id': 'req-f7e09d01-05ec-4ec0-a137-32d9b1056d11'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:24.719004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0606a9aabeef47c38e45be3ece0077b1', 'request_id': 'req-f7e09d01-05ec-4ec0-a137-32d9b1056d11'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:24.785147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] The token cache is being invalidate because project 0606a9aabeef47c38e45be3ece0077b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:24.787057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:24.790804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f7e09d01-05ec-4ec0-a137-32d9b1056d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:24.793800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 914/1814] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:24 2022] DELETE /identity/v3/projects/0606a9aabeef47c38e45be3ece0077b1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:24.818434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7a1-9f2f-4a7e-98bb-23cee3f02494 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:24.821478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7a1-9f2f-4a7e-98bb-23cee3f02494 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:24.821903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e7a1-9f2f-4a7e-98bb-23cee3f02494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:24.961298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:25.011259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.013868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.013868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.014080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.014760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.016418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a987e-3673-47cf-9259-c68826c68eb4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.022994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ae47e7a1-9f2f-4a7e-98bb-23cee3f02494 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:25.039245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 901/1815] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:25.040342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.041423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ae47e7a1-9f2f-4a7e-98bb-23cee3f02494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.044427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.044732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.091296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:25.096815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.134890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 902/1816] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:25.139110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.141495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.189932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372189f1-ae4d-4a39-a496-76d84ca2a414 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.209259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.210649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.212918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.213281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.213955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.216502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.246343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 915/1817] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:25.250808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.251101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.262136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 903/1818] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:25.263098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.264805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.299645 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d374a-969c-4a23-a18a-103495845858 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.309911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:25.313479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.314167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.316624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.316932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] PATH_INFO: `/v3/projects/81de865961be4c9cb00169b678511679/users/8c0b55f46e4545298323a129e731765f/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.350602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:25.353421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.360371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81de865961be4c9cb00169b678511679, user_id=8c0b55f46e4545298323a129e731765f, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.365607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97104806-ebaa-4dcf-b34a-319a9084df28 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.376356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 916/1819] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:25.380812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.399484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc10293-fb03-443d-8430-b6dc3e5d9be3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.405452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 904/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:25 2022] PUT /identity/v3/projects/81de865961be4c9cb00169b678511679/users/8c0b55f46e4545298323a129e731765f/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:25.420210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.423125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.423641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.470604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] MFA Rules not processed for user `8c0b55f46e4545298323a129e731765f`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:25.473244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.563487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.564123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.564402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.564830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.565547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:25.565786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.567406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.647836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 917/1821] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:06:25.648837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.657361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:25.663105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 905/1822] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:25.667647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.681889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5196cb1-f998-4b2b-b407-cbac07a270e9 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.689829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.690502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.690828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.691103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.691902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.695235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:25.766639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 906/1823] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:25.768959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:25.922274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4530ec-6af3-4122-9d0e-6839ee5efde9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.945503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a0e6e-43af-461c-a82e-c9b3c8d2c344 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:25.962117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:25.962767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:25.963028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:25.963299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:25.964613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:25.968562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.015454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:26.043868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 907/1824] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:25 2022] POST /identity/v3/projects => generated 407 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:26.048271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.169797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.170433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.170695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.171410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.211150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:26.217181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cd93b-1b6e-4532-abdb-5d565f5239b4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.239404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.240185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.240551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.240727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.241369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.243690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.295785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 908/1825] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:26 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:26.300633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.333728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fafe1-ee3b-4e35-b651-2314c4c4f93b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.336934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.344916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.353580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.361042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.361622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.362719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.365243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.378452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.380550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 918/1826] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:06:26.384827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.400801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217b2c2-a5fc-4314-ba21-8f1271f2c895 service swift] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.410037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.410327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.410612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.411012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.411683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.413422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.426416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 919/1827] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:26.432095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.444312 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29531120-1aec-459b-b1d8-62df67b008e4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.452786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.453549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.453836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.454243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.455184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.457602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.476554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 920/1828] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:26.477617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.499191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285f5ef-12a8-454d-a864-7cbeed3f4eb1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.507894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 909/1829] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:26 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:26.508697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.509658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.510042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.510338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] PATH_INFO: `/v3/projects/182cf2053a884e9db0839d10fbdd771b/users/22e9acd0c2af46749ff88bde96e65dc3/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.514832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.530725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182cf2053a884e9db0839d10fbdd771b, user_id=22e9acd0c2af46749ff88bde96e65dc3, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.534320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766043-e6b5-431f-802e-fed23ca28bc6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.555853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 921/1830] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:26 2022] PUT /identity/v3/projects/182cf2053a884e9db0839d10fbdd771b/users/22e9acd0c2af46749ff88bde96e65dc3/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:26.575259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.575259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.575259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.584047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2039-54c0-4ba7-b6e1-89c6fef61c42 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:26.697795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] MFA Rules not processed for user `22e9acd0c2af46749ff88bde96e65dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:26.711932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:26.911420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:26.912298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:26.912298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:26.912508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:26.913753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:26.915398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:26.946780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 910/1831] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:26.948635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:26.980383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad783e4-637b-4c19-8310-9808d4176a2b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:27.018126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:27.021449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:27.024557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:27.024851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] PATH_INFO: `/v3/projects/a662a9fc252043f0a25e80ef12491a7a/users/73cd69fe3185420b9bb80c650ceec56e/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:27.070200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 922/1832] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:27.083454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:27.116568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdb4c-11a2-4402-a336-7d2938568c7a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:27.126215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:27.127079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:27.127550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:27.128250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:27.129778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:27.132171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662a9fc252043f0a25e80ef12491a7a, user_id=73cd69fe3185420b9bb80c650ceec56e, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:27.138251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:27.146371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:27.234050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 911/1833] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:26 2022] PUT /identity/v3/projects/a662a9fc252043f0a25e80ef12491a7a/users/73cd69fe3185420b9bb80c650ceec56e/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:27.239627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:27.338621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 923/1834] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:27 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:27.339763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:27.554729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:27.623263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:27.699581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b60dcd-8953-49f5-8692-5e96f72f6ba7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:27.771103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97a53-dc9a-4524-bbc4-b51625a93f1a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:27.799048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:27.810115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:27.815100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:27.815847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:27.824020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:27.866540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:27.962762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 924/1835] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:27 2022] POST /identity/v3/users => generated 290 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:27.964451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:28.013466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:28.014216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.014722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.014837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.015430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:28.015666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c331263-97a6-4411-bbf4-ace80c68b8e5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:28.017129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2e9ab-814d-4502-8ec9-bb1b75280985 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:28.033455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:28.035739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.037029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.038815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.041367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:28.050147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:28.050529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 912/1836] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 812 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:28.053980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74dd3-0273-4381-a846-0a0db64d8fbe None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.054278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74dd3-0273-4381-a846-0a0db64d8fbe None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.054556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e74dd3-0273-4381-a846-0a0db64d8fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.089276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 925/1837] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:28.089276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:28.115948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d3c6-f356-42ac-b7ab-fc23de7a0cde admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:28.136343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:28.138684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.139520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.139811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] PATH_INFO: `/v3/projects/a662a9fc252043f0a25e80ef12491a7a/users/73cd69fe3185420b9bb80c650ceec56e/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.146308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a662a9fc252043f0a25e80ef12491a7a, user_id=73cd69fe3185420b9bb80c650ceec56e, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:28.148539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-15e74dd3-0273-4381-a846-0a0db64d8fbe None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:28.154600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:28.155332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-15e74dd3-0273-4381-a846-0a0db64d8fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:28.196592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 926/1838] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:28 2022] PUT /identity/v3/projects/a662a9fc252043f0a25e80ef12491a7a/users/73cd69fe3185420b9bb80c650ceec56e/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:28.197221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:28.358710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 913/1839] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Sep 7 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:28.362974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.363537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.363927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.492044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] MFA Rules not processed for user `73cd69fe3185420b9bb80c650ceec56e`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:28.493462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:28.546127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b24b2-58dd-4178-b500-d3bff0a2cd43 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:28.573276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:28.574034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:28.574344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:28.575708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] PATH_INFO: `/v3/projects/ae6ce10de4ee49fdb982837a49372142/users/82c8363ef2c0462283f2664553f466d1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:28.632547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6ce10de4ee49fdb982837a49372142, user_id=82c8363ef2c0462283f2664553f466d1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:28.645034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:28.686590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 927/1840] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:28 2022] PUT /identity/v3/projects/ae6ce10de4ee49fdb982837a49372142/users/82c8363ef2c0462283f2664553f466d1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:28.690622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:28.743531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 914/1841] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:28.797089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:28.798683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:28.855375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:28.959105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7eae5-4484-4956-be40-e826c2839312 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:29.063362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d049d3-dd57-4fb4-ac42-e352250209c9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:29.076370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:29.077110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.077302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.077572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.079638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:29.083605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:29.100968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:29.101757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.102161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.102547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.129910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 928/1842] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:29.135582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:29.140314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:29.243965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:29.316496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:29.318413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:29.347221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 915/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:28 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:29.348463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:29.375156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd4908-2ac0-4d9f-ac38-663fdacbcdd7 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:29.384932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:29.385994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.391989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.392614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] PATH_INFO: `/v3/projects/ae6ce10de4ee49fdb982837a49372142/users/82c8363ef2c0462283f2664553f466d1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.395988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6ce10de4ee49fdb982837a49372142, user_id=82c8363ef2c0462283f2664553f466d1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:29.402354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe157107-4602-44d0-b4a3-1a8c03075982 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:29.413187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3ed39-1b9e-472b-886e-21cb2acf4374 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:29.432149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:29.436986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 916/1844] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:29 2022] PUT /identity/v3/projects/ae6ce10de4ee49fdb982837a49372142/users/82c8363ef2c0462283f2664553f466d1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:29.446118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.446118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.446118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.452189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:29.459992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:29.460630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:29.471107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:29.475499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:29.509049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 929/1845] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:29.597083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] MFA Rules not processed for user `82c8363ef2c0462283f2664553f466d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:29.601583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:29.857753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:29.896468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 917/1846] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:30.187367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:30.204762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dc410-595d-4a23-8d8b-da68272e28d4 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:30.412187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:30.412740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:30.413022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:30.413386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:30.425894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:30.428408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:30.446194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4f906-a803-43e0-975e-21823aa513a8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:30.451389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:30.452306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:30.452782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:30.453232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:30.454993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:30.466614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:30.510656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 930/1847] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:30.555432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:30.556939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:30.583507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 918/1848] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:31.008935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:31.026327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675589b-3942-445e-882a-fa906bf79d14 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:31.039695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:31.041444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:31.043057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:31.046700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:31.257155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:31.262546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38936c03-cfe8-48bf-9ce9-2eaa7ad52592 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:31.305924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 931/1849] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:32.576755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:32.578334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:32.831731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4ff27-f874-47a4-b6a7-6901d909e4e5 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:32.841819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:32.842940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:32.843554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:32.844056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] PATH_INFO: `/v3/users/81cbdeb679ee4092bac7e251f2d95878` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:32.846662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cbdeb679ee4092bac7e251f2d95878)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:32.849620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:33.019168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cbdeb679ee4092bac7e251f2d95878'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:33.039825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cbdeb679ee4092bac7e251f2d95878'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:33.040623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cbdeb679ee4092bac7e251f2d95878'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:33.041510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cbdeb679ee4092bac7e251f2d95878'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:33.060599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cbdeb679ee4092bac7e251f2d95878'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:33.100406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 919/1850] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:32 2022] DELETE /identity/v3/users/81cbdeb679ee4092bac7e251f2d95878 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:33.106521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de069-701a-4b9b-860b-9be81efa6163 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:33.107353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de069-701a-4b9b-860b-9be81efa6163 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:33.107638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de069-701a-4b9b-860b-9be81efa6163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:33.174058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-727de069-701a-4b9b-860b-9be81efa6163 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:33.186239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-727de069-701a-4b9b-860b-9be81efa6163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:33.424850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 932/1851] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:33.447425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:33.450922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:33.512630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:33.690349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aafbc-3f68-4f71-b0ed-afc42bf1ca22 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:33.696030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:33.705310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:33.705866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:33.706376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:33.770647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:33.772812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26359b3c-40e4-4abb-9a11-a0e402794433 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:33.814806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 920/1852] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:34.930859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:34.931455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:34.931616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:34.933265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 933/1853] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:35.006779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295278-04c1-4e51-8123-11d3dd4ddf1c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:35.008040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295278-04c1-4e51-8123-11d3dd4ddf1c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:35.008537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99295278-04c1-4e51-8123-11d3dd4ddf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:35.068377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-99295278-04c1-4e51-8123-11d3dd4ddf1c None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:35.070183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-99295278-04c1-4e51-8123-11d3dd4ddf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:35.370208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 921/1854] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:36.490079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:36.492098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:36.530186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:36.558607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee17a4d-da0e-4b0a-97bf-d3c55af33bf5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:36.582234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:36.584725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:36.586672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:36.587955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:36.622174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:36.630583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dff2f-56a9-4477-99ef-f184642cf583 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:36.685154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 934/1855] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:37.147816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:37.148439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:37.148524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:37.150086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 922/1856] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:37.162608 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:37.163959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:37.164664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:37.233221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:37.236221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:37.255650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 935/1857] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:06:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:37.440811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:37.442601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:37.500963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb59ae-59f2-4f50-a453-327a5be791e7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:37.536934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:37.538974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:37.539487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:37.540167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:37.554120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:37.556715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:37.572834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 923/1858] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:37.629385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:37.631446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:37.664105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69d1b-f89b-44c2-aa64-c673455d68e0 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:37.688290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:37.690301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:37.690522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:37.697416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] PATH_INFO: `/v3/projects/30a90124d24d401a8b96af46e6ba93d7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:37.702054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a90124d24d401a8b96af46e6ba93d7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:37.712421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:37.881023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a90124d24d401a8b96af46e6ba93d7', 'request_id': 'req-795a3572-813f-4092-9042-3970b7d82615'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:37.928863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a90124d24d401a8b96af46e6ba93d7', 'request_id': 'req-795a3572-813f-4092-9042-3970b7d82615'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:37.964329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a90124d24d401a8b96af46e6ba93d7', 'request_id': 'req-795a3572-813f-4092-9042-3970b7d82615'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.035207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] The token cache is being invalidate because project 30a90124d24d401a8b96af46e6ba93d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:38.035408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.040092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.045417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 936/1859] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:37 2022] DELETE /identity/v3/projects/30a90124d24d401a8b96af46e6ba93d7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:38.061055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:38.086114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e41f8-36af-4edf-9c0e-b15c3651b054 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:38.174915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:38.176497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:38.261200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:38.264391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:38.264721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:38.265033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] PATH_INFO: `/v3/users/c318929123684b60b0206db6ff57d73a` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:38.266743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c318929123684b60b0206db6ff57d73a)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:38.274175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:38.404930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3572-813f-4092-9042-3970b7d82615 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:38.410656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:38.417611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:38.420019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:38.420745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:38.422824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] PATH_INFO: `/v3/users/8c0b55f46e4545298323a129e731765f` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:38.425417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0b55f46e4545298323a129e731765f)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:38.451175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c318929123684b60b0206db6ff57d73a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.453996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:38.490967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c318929123684b60b0206db6ff57d73a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.492833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c318929123684b60b0206db6ff57d73a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.498621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c318929123684b60b0206db6ff57d73a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.513590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c318929123684b60b0206db6ff57d73a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.575497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 924/1860] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:38 2022] DELETE /identity/v3/users/c318929123684b60b0206db6ff57d73a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:38.608004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0b55f46e4545298323a129e731765f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.618733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:38.620769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:38.623875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0b55f46e4545298323a129e731765f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.624827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0b55f46e4545298323a129e731765f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.625543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0b55f46e4545298323a129e731765f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.641937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:38.643988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-dfed85d8-d543-40b6-8c7b-97c877b6e48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0b55f46e4545298323a129e731765f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:38.671878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 937/1861] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:38 2022] DELETE /identity/v3/users/8c0b55f46e4545298323a129e731765f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:38.674921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:38.675269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:38.677155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:38.728150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:38.729438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:38.800507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177bf19f-4e6b-47be-9fbc-7e33acbd61bd admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:38.814882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 938/1862] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:38.869264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:38.873157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:38.987221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:38.989886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:38.990168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:38.990446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] PATH_INFO: `/v3/users/22e9acd0c2af46749ff88bde96e65dc3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:38.993541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e9acd0c2af46749ff88bde96e65dc3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:39.001420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:39.041150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e4fa-a585-4550-9a0a-bdb05c1e300a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:39.052367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:39.053207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:39.053643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:39.054071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:39.070296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:39.072814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0931-17c3-482f-83d0-428c06231948 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:39.100863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e9acd0c2af46749ff88bde96e65dc3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:39.112201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 939/1863] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:39.117748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e9acd0c2af46749ff88bde96e65dc3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:39.118488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e9acd0c2af46749ff88bde96e65dc3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:39.119171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e9acd0c2af46749ff88bde96e65dc3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:39.131751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e9acd0c2af46749ff88bde96e65dc3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:39.133072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:39.159552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 925/1864] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:38 2022] DELETE /identity/v3/users/22e9acd0c2af46749ff88bde96e65dc3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:39.163723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:39.164181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:39.164750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:39.193539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:39.194862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:39.316701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 940/1865] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:39.343303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:39.346120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:39.452340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2a56-24cf-4b98-9d11-c0c302430493 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:39.465739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:39.466484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:39.466807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:39.467779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:39.525954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:39.527843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:39.539330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 926/1866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:39.928576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:39.930893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:39.948326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8bf83-107e-4fd2-952b-594d9f72dc84 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:39.960777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:39.961887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:39.961887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:39.962253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] PATH_INFO: `/v3/projects/3262f281af64449e9f3d54b94f831019` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:39.963915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3262f281af64449e9f3d54b94f831019)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:39.967681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.024049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:40.062966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3262f281af64449e9f3d54b94f831019', 'request_id': 'req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.074256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3262f281af64449e9f3d54b94f831019', 'request_id': 'req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.077974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.083754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3262f281af64449e9f3d54b94f831019', 'request_id': 'req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.084194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.099119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] The token cache is being invalidate because project 3262f281af64449e9f3d54b94f831019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:40.099320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.100117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-382b8904-3cb8-4cd7-bea4-dcdafdd7571d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.102131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 941/1867] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:39 2022] DELETE /identity/v3/projects/3262f281af64449e9f3d54b94f831019 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:40.108320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7c51-fa0c-4248-97ca-ddc3777d7d45 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.108320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7c51-fa0c-4248-97ca-ddc3777d7d45 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.108619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7c51-fa0c-4248-97ca-ddc3777d7d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.111300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb8ad9-3d78-40e4-9187-bd380eab6a6f service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.139382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0dcf7c51-fa0c-4248-97ca-ddc3777d7d45 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:40.140744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0dcf7c51-fa0c-4248-97ca-ddc3777d7d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.212132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.213239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.213671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.213826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 942/1868] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:40.214241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] PATH_INFO: `/v3/projects/81de865961be4c9cb00169b678511679` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.215747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81de865961be4c9cb00169b678511679)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.219004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.222450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.222716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.223136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.268110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:40.269430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.283613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81de865961be4c9cb00169b678511679', 'request_id': 'req-84cf5611-b003-440c-bd1e-5a61f1aa9c16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.297296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81de865961be4c9cb00169b678511679', 'request_id': 'req-84cf5611-b003-440c-bd1e-5a61f1aa9c16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.305214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81de865961be4c9cb00169b678511679', 'request_id': 'req-84cf5611-b003-440c-bd1e-5a61f1aa9c16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.317564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] The token cache is being invalidate because project 81de865961be4c9cb00169b678511679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:40.317852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.319732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.321964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 927/1869] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:40 2022] DELETE /identity/v3/projects/81de865961be4c9cb00169b678511679 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:40.322725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.324026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.339180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:40.357234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 943/1870] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:40.357927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.359213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.371022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cce981-4fd6-4199-850d-96fa688a990b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.377762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.378412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.378700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.378975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] PATH_INFO: `/v3/users/73cd69fe3185420b9bb80c650ceec56e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.380368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cd69fe3185420b9bb80c650ceec56e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.382707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.404946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf5611-b003-440c-bd1e-5a61f1aa9c16 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.410563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.411094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.411426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.411706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] PATH_INFO: `/v3/projects/182cf2053a884e9db0839d10fbdd771b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.412832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] RBAC: Authorizing `identity:delete_project(project_id=182cf2053a884e9db0839d10fbdd771b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.414907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.454662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cd69fe3185420b9bb80c650ceec56e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.457234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:40.464379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cd69fe3185420b9bb80c650ceec56e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.464567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182cf2053a884e9db0839d10fbdd771b', 'request_id': 'req-d4005c60-26e0-4717-8f73-30295d32194b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.466500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cd69fe3185420b9bb80c650ceec56e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.468333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cd69fe3185420b9bb80c650ceec56e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.472486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182cf2053a884e9db0839d10fbdd771b', 'request_id': 'req-d4005c60-26e0-4717-8f73-30295d32194b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.477981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182cf2053a884e9db0839d10fbdd771b', 'request_id': 'req-d4005c60-26e0-4717-8f73-30295d32194b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.483116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cd69fe3185420b9bb80c650ceec56e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.490203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] The token cache is being invalidate because project 182cf2053a884e9db0839d10fbdd771b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:40.490497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.491150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.492960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 928/1871] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:40 2022] DELETE /identity/v3/projects/182cf2053a884e9db0839d10fbdd771b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:40.493605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.496823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.497844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 944/1872] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:40 2022] DELETE /identity/v3/users/73cd69fe3185420b9bb80c650ceec56e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:40.501105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.502141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.579633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e1999-a11c-4069-a1cd-224e0cd1ea7a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.584565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.585193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.585472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.585752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] PATH_INFO: `/v3/users/82c8363ef2c0462283f2664553f466d1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.586983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c8363ef2c0462283f2664553f466d1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.588986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.616529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005c60-26e0-4717-8f73-30295d32194b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.625535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.626216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.626717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.627567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.628342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:40.628861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.630675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.652082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 929/1873] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:40.657118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.671849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e5f70-c595-4afb-a4dc-41f5a1ca3506 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.677478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.678195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.678351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.678627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.679334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.682082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:40.689693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c8363ef2c0462283f2664553f466d1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.725734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 930/1874] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:40 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:40.729890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.736012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c8363ef2c0462283f2664553f466d1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.737626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c8363ef2c0462283f2664553f466d1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.739475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c8363ef2c0462283f2664553f466d1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.754352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c8363ef2c0462283f2664553f466d1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:40.769407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 945/1875] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:40 2022] DELETE /identity/v3/users/82c8363ef2c0462283f2664553f466d1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:40.771974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:40.849933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cac0e-265f-40a7-a3d7-8ce0e3fa3ed2 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:40.860761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:40.862974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:40.969952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:40.971312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:40.971856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:40.973820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:40.974344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:40.974855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:40.977406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.009420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d36b0f-e907-45e9-8066-11c6386f7cd1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.013085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 931/1876] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:40 2022] POST /identity/v3/users => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:41.018379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.022098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.023307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.024185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.024369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.024635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] PATH_INFO: `/v3/projects/a662a9fc252043f0a25e80ef12491a7a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.026862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a662a9fc252043f0a25e80ef12491a7a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.027970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.053873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506268ec-0829-417e-b2c4-cacf0eab92c6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.071874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.072602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.072989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.073339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.075720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.078010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.095677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 932/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:41.100638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.116733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a662a9fc252043f0a25e80ef12491a7a', 'request_id': 'req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.117284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ff771-23b5-4a8d-be4c-65759d46e466 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.138070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a662a9fc252043f0a25e80ef12491a7a', 'request_id': 'req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.152353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a662a9fc252043f0a25e80ef12491a7a', 'request_id': 'req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.200585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] The token cache is being invalidate because project a662a9fc252043f0a25e80ef12491a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:41.202108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.203409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2609c2f4-fbe5-4d60-b086-d44ebc644b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.206995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 946/1878] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:40 2022] DELETE /identity/v3/projects/a662a9fc252043f0a25e80ef12491a7a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:41.213062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.213719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.214003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.214308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.216036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.218170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.218448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b056-b245-45df-8d37-1f58e8260cfa None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.218744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b056-b245-45df-8d37-1f58e8260cfa None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.219022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b056-b245-45df-8d37-1f58e8260cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.250528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 933/1879] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:41.251476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.256648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.270933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b0d0b056-b245-45df-8d37-1f58e8260cfa None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:41.272183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b0d0b056-b245-45df-8d37-1f58e8260cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.280832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce08f6-a386-4ee0-bd04-4072eb5d5200 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.290086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 947/1880] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:41.297654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.298618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.299293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.303175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.303175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.303658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.303972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] PATH_INFO: `/v3/projects/587557ad787449709f805afe0a6420f7/users/001cf3f08f7f40c09c108afae2e536f2/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.349671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] RBAC: Authorizing `identity:create_grant(project_id=587557ad787449709f805afe0a6420f7, user_id=001cf3f08f7f40c09c108afae2e536f2, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.352851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:41.354009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.354130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101def9-b5e4-495b-a364-29590030211e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.367949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 948/1881] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:41.369302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.379437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 934/1882] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:41 2022] PUT /identity/v3/projects/587557ad787449709f805afe0a6420f7/users/001cf3f08f7f40c09c108afae2e536f2/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:41.390301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.390607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.390875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.393924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17eae9-b668-442f-9f55-76c9914c21cd None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.420681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:41.424505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] MFA Rules not processed for user `001cf3f08f7f40c09c108afae2e536f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:41.428096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.495779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.496562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.496862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.497236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.498179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:41.498494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.500483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.528611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 949/1883] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:41.530877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 935/1884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:41.533122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.535793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.551143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b01027-d19f-44d2-8849-d255e9e094bb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.555222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99ef5f-9466-4bb0-9ccd-ee0158ad707e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.557581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.558577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.558785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.559244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.560166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.562780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.567115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.570407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.572065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.572347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.573008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.576532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.603101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 936/1885] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:41.607774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.616275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 950/1886] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:41.620985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.681180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:41.698570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844689b4-53b5-49db-a7a1-f4650a420a0f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.716282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e947c-2ba5-4a30-882d-a457f238723a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.726415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.728277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.728586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.728949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.729694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.732363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.770738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 951/1887] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:41.771642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.773734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:41.804365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.805713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.805993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.806261 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.807077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.812918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465c9e-59a3-4644-a050-381c33d2e1f3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.820181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.821140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.821556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.821964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] PATH_INFO: `/v3/projects/ae6ce10de4ee49fdb982837a49372142` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.823414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6ce10de4ee49fdb982837a49372142)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.825031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.826649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.860206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 937/1888] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:41 2022] POST /identity/v3/users => generated 306 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:41.860206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.874395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81b2e6-3228-4ca4-8965-f50ae22d2e61 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.879921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:41.880520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:41.880793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:41.881214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:41.882268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:41.883794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:41.893649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6ce10de4ee49fdb982837a49372142', 'request_id': 'req-0763850a-0e25-41a2-8d60-93f838c3ed5e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.903936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6ce10de4ee49fdb982837a49372142', 'request_id': 'req-0763850a-0e25-41a2-8d60-93f838c3ed5e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.904273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 938/1889] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:41.906166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.910652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6ce10de4ee49fdb982837a49372142', 'request_id': 'req-0763850a-0e25-41a2-8d60-93f838c3ed5e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.923103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dae45f-4e53-49df-8e41-b1280d972e1f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:41.925515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] The token cache is being invalidate because project ae6ce10de4ee49fdb982837a49372142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:41.925911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.926686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:41.929541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:41.931622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 952/1890] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:41 2022] DELETE /identity/v3/projects/ae6ce10de4ee49fdb982837a49372142 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:41.933853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:41.937811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.010084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.010767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.011179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.011454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.012353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.013976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda11e4-975f-449f-9d88-14c28c490a0f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.019039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763850a-0e25-41a2-8d60-93f838c3ed5e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.025099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 939/1891] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:42.025552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.026526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.026967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.027939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.028877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.030529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.030874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.031005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.031293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.045955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 953/1892] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:42.047401 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.050144 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.054370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:42.056342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.065253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ba13-810d-4c86-a325-533afc8fb11c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.067518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 940/1893] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:42.068326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.070992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.071820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.072026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.072394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] PATH_INFO: `/v3/projects/bc06914bf093454c952c9fd4d8243ce5/users/e5a0bda6265545b0a01dd26c755f9cef/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.085086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af50ee-43ee-483a-b081-efee2d069979 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.089976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.090747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.091034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.091308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] PATH_INFO: `/v3/projects/9d978c5eea6041f7891deb7cae66df22/users/b24d6686fd6d4813b206133357e2c8e5/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.094404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc06914bf093454c952c9fd4d8243ce5, user_id=e5a0bda6265545b0a01dd26c755f9cef, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.097154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff70ed-486b-4961-93ef-7f1edcf98a94 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.108624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d978c5eea6041f7891deb7cae66df22, user_id=b24d6686fd6d4813b206133357e2c8e5, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.111277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.115611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 954/1894] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:42 2022] PUT /identity/v3/projects/bc06914bf093454c952c9fd4d8243ce5/users/e5a0bda6265545b0a01dd26c755f9cef/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:42.117931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f1e1-5674-4425-9f16-8890a17d08f3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.117931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f1e1-5674-4425-9f16-8890a17d08f3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.117931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726f1e1-5674-4425-9f16-8890a17d08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.129131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 941/1895] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:42 2022] PUT /identity/v3/projects/9d978c5eea6041f7891deb7cae66df22/users/b24d6686fd6d4813b206133357e2c8e5/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:42.130048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.139280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2726f1e1-5674-4425-9f16-8890a17d08f3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:42.140689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2726f1e1-5674-4425-9f16-8890a17d08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.153845 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:42.193515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89d1a4-e3cd-4239-9d43-2fd68a5b2e50 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.198499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.199106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.199603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.199877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.200804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.202399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.207183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 955/1896] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:42.207183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b745c5-5f4b-46e4-9485-6b83ddf97dc1 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.207183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b745c5-5f4b-46e4-9485-6b83ddf97dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.207183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b745c5-5f4b-46e4-9485-6b83ddf97dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.216390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 942/1897] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:42.217225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.226946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3034f9f-3520-42d9-a9c1-5683dbe125d6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.232096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.232682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.232964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.233234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.233863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:42.234163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.234551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-19b745c5-5f4b-46e4-9485-6b83ddf97dc1 None None] MFA Rules not processed for user `b24d6686fd6d4813b206133357e2c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:42.235781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19b745c5-5f4b-46e4-9485-6b83ddf97dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.235900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.248566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 943/1898] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:42.249348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.258661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd0ed7-6e46-4251-ad5f-de826a0c9f12 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.264738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.265378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.265650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.265918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] PATH_INFO: `/v3/projects/bc06914bf093454c952c9fd4d8243ce5/users/e5a0bda6265545b0a01dd26c755f9cef/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.267851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc06914bf093454c952c9fd4d8243ce5, user_id=e5a0bda6265545b0a01dd26c755f9cef, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.270462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.281105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 944/1899] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:42 2022] PUT /identity/v3/projects/bc06914bf093454c952c9fd4d8243ce5/users/e5a0bda6265545b0a01dd26c755f9cef/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:42.292445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.307802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 956/1900] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:42.309796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.310001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.310406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.343684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] MFA Rules not processed for user `e5a0bda6265545b0a01dd26c755f9cef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:42.344894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.346133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:42.377987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c62784-3362-415e-bd06-14ef51718ee9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.383828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.384509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.384861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.385200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.386511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.388856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.426805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 945/1901] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:42.426805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.431221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.446025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 957/1902] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:42.447208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.460087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a23c-0758-4e65-8342-fbaf47e97e2c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.501517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:42.552052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.552838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.553119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.553396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.554879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.558258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.561562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f614bd-62dc-43b7-8081-eff2d852a727 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.579500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.582898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.583417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.583796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.594782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 958/1903] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:42 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:42.595820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.598111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:42.695361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded670f-6d66-46e7-b437-2e614fc0996d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.700427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.701281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.701562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.701906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.739076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.743382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.768876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 946/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:42.772294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.798760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958b52-33c7-4741-8b55-f02da3382188 service glance] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.805225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.806961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.820126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 959/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:42.832733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.833358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.833635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.833904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.834549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.836489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.850811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 947/1906] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:42.854670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.882588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb092656-a3a6-45d8-b1b7-47b68bd2a9a8 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.903621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.904787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.906220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.913533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.926437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:42.928179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:42.942979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 960/1907] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:42.946751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.954985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:42.969957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced977ca-0e29-4b72-b6b6-89cc2d455113 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.983414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.985437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:42.986377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:42.987113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] PATH_INFO: `/v3/projects/3c5806697686490cbbe9940593a56346/users/01df1a161ca74281b3a8a622d5776b17/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:42.989966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db90e15-0987-42a3-9a84-2ef4d5cb3730 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:42.995739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:42.997913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:43.007008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:43.007331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:43.014448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:43.031437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c5806697686490cbbe9940593a56346, user_id=01df1a161ca74281b3a8a622d5776b17, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:43.034537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7343af-75a3-4a36-a2c8-c40e434d7a5c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:43.062851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 948/1908] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:42 2022] PUT /identity/v3/projects/3c5806697686490cbbe9940593a56346/users/01df1a161ca74281b3a8a622d5776b17/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:43.073458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d9953-1bac-4ae0-b2dd-d71eb83a0382 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:43.074734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d9953-1bac-4ae0-b2dd-d71eb83a0382 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:43.075410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d9953-1bac-4ae0-b2dd-d71eb83a0382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:43.151979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-302d9953-1bac-4ae0-b2dd-d71eb83a0382 None None] MFA Rules not processed for user `01df1a161ca74281b3a8a622d5776b17`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:43.156454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-302d9953-1bac-4ae0-b2dd-d71eb83a0382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:43.189482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:43.191078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:43.193116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:43.215974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 961/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:43.282747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 949/1910] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:43.293183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:43.299194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:43.308270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ede70-ecf1-442e-90a6-828e5bafbde2 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:43.441996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:43.442763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:43.443356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:43.443495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:43.456795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:43.458522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd233300-a4bd-4841-9e30-7f15b69e92eb service glance] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:43.470716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 962/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:45.083946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:45.085017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:45.085498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:45.087155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 950/1912] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:06:45.128533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:45.129676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:45.129901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:45.160405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:45.162727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:45.389875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 963/1913] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:45.489763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:45.493142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:45.526526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a1740-4ca8-46bc-baa5-03465de74e43 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:45.534335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:45.535044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:45.535429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:45.536056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:45.550336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:45.553284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534c34-f1b3-4d69-a8bf-d8c0b0623996 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:45.565606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 951/1914] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:48.398276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:48.501819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6baa3-679f-4421-9e40-112a7c3781a4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:48.506649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:48.507500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:48.507687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:48.508002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] PATH_INFO: `/v3/users/001cf3f08f7f40c09c108afae2e536f2` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:48.509141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=001cf3f08f7f40c09c108afae2e536f2)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:48.511165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:48.588187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:48.595254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001cf3f08f7f40c09c108afae2e536f2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:48.604928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001cf3f08f7f40c09c108afae2e536f2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:48.605707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001cf3f08f7f40c09c108afae2e536f2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:48.606399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001cf3f08f7f40c09c108afae2e536f2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:48.626061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001cf3f08f7f40c09c108afae2e536f2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:48.644251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 964/1915] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:48 2022] DELETE /identity/v3/users/001cf3f08f7f40c09c108afae2e536f2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:48.646195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:48.646743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:48.646841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:48.669073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:48.670595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:48.756193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 952/1916] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:48.767201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:48.768751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:48.836789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ad2d4-b174-45d9-a70f-4ae91ab13d0a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:48.841349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:48.841956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:48.842229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:48.842498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:48.852162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:48.853564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:48.864004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 965/1917] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:49.244613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:49.246637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:49.258463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259a17d-c41d-41bb-b495-869aa1f42e3b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:49.265136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:49.265774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:49.266152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:49.266330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] PATH_INFO: `/v3/projects/587557ad787449709f805afe0a6420f7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:49.274108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587557ad787449709f805afe0a6420f7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:49.284715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:49.348238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587557ad787449709f805afe0a6420f7', 'request_id': 'req-bf882437-7095-4890-9788-3b10deeab108'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.356364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587557ad787449709f805afe0a6420f7', 'request_id': 'req-bf882437-7095-4890-9788-3b10deeab108'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.363892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587557ad787449709f805afe0a6420f7', 'request_id': 'req-bf882437-7095-4890-9788-3b10deeab108'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.376628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] The token cache is being invalidate because project 587557ad787449709f805afe0a6420f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:49.376919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.377574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.379066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 953/1918] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:49 2022] DELETE /identity/v3/projects/587557ad787449709f805afe0a6420f7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:49.383275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:49.393115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b494d0e-56ba-460c-80c9-8f54a2115eef service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:49.471380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:49.472221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:49.472601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:49.472974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] PATH_INFO: `/v3/users/e5a0bda6265545b0a01dd26c755f9cef` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:49.476203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a0bda6265545b0a01dd26c755f9cef)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:49.478388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:49.582218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a0bda6265545b0a01dd26c755f9cef'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.619778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a0bda6265545b0a01dd26c755f9cef'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.621985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a0bda6265545b0a01dd26c755f9cef'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.627166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a0bda6265545b0a01dd26c755f9cef'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.638405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:49.676918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-16058ef7-02f2-4d44-b542-1deaae9b3d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a0bda6265545b0a01dd26c755f9cef'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:49.703931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 966/1919] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:49 2022] DELETE /identity/v3/users/e5a0bda6265545b0a01dd26c755f9cef => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:50.185708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:50.187412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.207851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf882437-7095-4890-9788-3b10deeab108 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:50.242042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:50.309955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:50.311211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.311713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.312165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] PATH_INFO: `/v3/projects/bc06914bf093454c952c9fd4d8243ce5` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.313882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc06914bf093454c952c9fd4d8243ce5)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:50.316661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:50.419807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc06914bf093454c952c9fd4d8243ce5', 'request_id': 'req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.439251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc06914bf093454c952c9fd4d8243ce5', 'request_id': 'req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.453951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc06914bf093454c952c9fd4d8243ce5', 'request_id': 'req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.471347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] The token cache is being invalidate because project bc06914bf093454c952c9fd4d8243ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:50.471709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.472749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-13929c36-7d42-41fa-866a-a8ec0c3e2e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.478542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 954/1920] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:50 2022] DELETE /identity/v3/projects/bc06914bf093454c952c9fd4d8243ce5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:50.485023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.485526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.487141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.559758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:50.562229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.696297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 967/1921] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:50.705199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.705734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.706050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.729652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:50.731316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.740557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:50.741986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.743368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 955/1922] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:06:50.748310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:50.756058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a49d5e-817c-4651-a6e5-db1e1ab12ff7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:50.760480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e47cca-90af-4b33-9d30-a27b898850e5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:50.761313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:50.762735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.763097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.763550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] PATH_INFO: `/v3/users/484002ed97a845e7b36394a564f95ed3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.764759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484002ed97a845e7b36394a564f95ed3)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:50.766695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:50.772133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:50.772901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.773186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.773459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.774137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:50.774466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:50.776221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:50.791914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 956/1923] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:06:50.797433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:50.814458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3f41c-4a7e-4239-85bc-2eba2f71a4e3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:50.820143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:50.820838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.821121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.821389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.822019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:50.824856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:50.835814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484002ed97a845e7b36394a564f95ed3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.852011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484002ed97a845e7b36394a564f95ed3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.854366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484002ed97a845e7b36394a564f95ed3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.855598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484002ed97a845e7b36394a564f95ed3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.861839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 957/1924] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:50.865512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:50.867251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.881538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-22f43d45-de91-481f-a003-337baf7ca414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484002ed97a845e7b36394a564f95ed3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:50.909276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 968/1925] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:50 2022] DELETE /identity/v3/users/484002ed97a845e7b36394a564f95ed3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:50.914525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:50.915019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:50.915362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:50.937288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:50.938867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:50.961907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783df20f-cfad-419d-af43-40d7c58ec3f5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:50.984163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:51.004825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:51.028302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 969/1926] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:51.042801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.046165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:51.089684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.089684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.089684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.090290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.091333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.094575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.145619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 958/1927] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:50 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:51.149840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.177532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036e1e6-52fc-426c-ac10-eb8316d1588f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:51.191219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094e903-858a-4f77-ac4f-e5c872b590ab None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:51.193836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.194449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.194727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.194988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.195660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.197260 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.204172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.204748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.205045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.205436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.226335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 959/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:51.231099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.232638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.234108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.251437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b3e1-c5ed-4308-9aaf-bd4752cdb335 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:51.257535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 970/1929] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:51.263155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.264015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.264395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.264821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.265613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.267676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da939-4702-43fd-bdf9-34f9d31847fd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.287711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 960/1930] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:51.289031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.301338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59283-f3ae-4c23-81f8-197043580333 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:51.305692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.306588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.306914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.307243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] PATH_INFO: `/v3/projects/a537f74c8a4e4449bf40dff6a57b6f7e/users/a0585a1b01814e039c6f9e7fb24e6ca5/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.329145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a537f74c8a4e4449bf40dff6a57b6f7e, user_id=a0585a1b01814e039c6f9e7fb24e6ca5, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.330767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.382965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 971/1931] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:51 2022] PUT /identity/v3/projects/a537f74c8a4e4449bf40dff6a57b6f7e/users/a0585a1b01814e039c6f9e7fb24e6ca5/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:51.410193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.410480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.410744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.469315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] MFA Rules not processed for user `a0585a1b01814e039c6f9e7fb24e6ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:51.471118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:51.629461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 961/1932] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:51.635185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.784593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f2b72-41c6-46f1-8ba4-d9e49e5c4dbd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:51.801451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:51.802090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:51.802372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:51.802643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:51.803302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:51.805519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:51.867941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 972/1933] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:51 2022] POST /identity/v3/projects => generated 387 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:51.869583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:51.892705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b130ee2-fbe5-4f43-b761-8e152cf6c679 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.028773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.029523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.029800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.030067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.030724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.033090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.073632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 962/1934] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:51 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:52.075759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.086233 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2195-c5e3-4164-97bc-89b39c251d4d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.092815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.093453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.093719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.093991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.094675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.096344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.111587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 973/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:52.115345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.129784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bf82-0c28-468c-8e6d-b89701d964e1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.135144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.135962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.136274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.137125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] PATH_INFO: `/v3/projects/8c7727801453479b93c8b02113017fd6/users/d45f3a0a68b54ad8a88c842ee57ad649/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.155964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:52.166082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7727801453479b93c8b02113017fd6, user_id=d45f3a0a68b54ad8a88c842ee57ad649, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.170230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.191107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 963/1936] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:52 2022] PUT /identity/v3/projects/8c7727801453479b93c8b02113017fd6/users/d45f3a0a68b54ad8a88c842ee57ad649/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:52.194775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.206363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1bcff-8f9a-4f21-bf65-721c9379ec30 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.243526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.245239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:52.273430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:52.304242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.305916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.306597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.307276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.309121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.311568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.322595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 974/1937] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:52.323856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a113-9789-4e06-b7c9-3a8ce15d0b63 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.327849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.331295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.331971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.332251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.332519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] PATH_INFO: `/v3/projects/81d1c3c3525e4f108bd54185c3767a80` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.333727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d1c3c3525e4f108bd54185c3767a80)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.335935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.341346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26928244-8e17-4aad-9570-6a6517b1801d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.349321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.350155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.350438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.350718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] PATH_INFO: `/v3/projects/8c7727801453479b93c8b02113017fd6/users/d45f3a0a68b54ad8a88c842ee57ad649/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.353259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7727801453479b93c8b02113017fd6, user_id=d45f3a0a68b54ad8a88c842ee57ad649, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.356152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9423c-f1b4-4b64-a360-6a9b59327050 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.370595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 975/1938] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:52 2022] PUT /identity/v3/projects/8c7727801453479b93c8b02113017fd6/users/d45f3a0a68b54ad8a88c842ee57ad649/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:52.385344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.385714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.386057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.421022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] MFA Rules not processed for user `d45f3a0a68b54ad8a88c842ee57ad649`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:52.422314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:52.442907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d1c3c3525e4f108bd54185c3767a80', 'request_id': 'req-a205e135-3ee5-434c-8f12-14124faa3009'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.453751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d1c3c3525e4f108bd54185c3767a80', 'request_id': 'req-a205e135-3ee5-434c-8f12-14124faa3009'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.463256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d1c3c3525e4f108bd54185c3767a80', 'request_id': 'req-a205e135-3ee5-434c-8f12-14124faa3009'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.488309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] The token cache is being invalidate because project 81d1c3c3525e4f108bd54185c3767a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:52.488624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.489349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.491099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 964/1939] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:52 2022] DELETE /identity/v3/projects/81d1c3c3525e4f108bd54185c3767a80 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:52.494715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.502598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:52.547562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 976/1940] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:52.553223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:52.554885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:52.621851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205e135-3ee5-434c-8f12-14124faa3009 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.628817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.629539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.630436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.631035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] PATH_INFO: `/v3/users/048e1b80533f42aa830afe0dc6fe821a` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.634810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e1b80533f42aa830afe0dc6fe821a)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.636867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b601df-f8b5-471b-8330-05deaf2a9339 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:52.637630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.641329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:52.642280 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:52.642607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:52.642908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:52.652880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:52.654347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:52.657345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:52.670837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 977/1941] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:52.708887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e1b80533f42aa830afe0dc6fe821a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.723073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e1b80533f42aa830afe0dc6fe821a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.723977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e1b80533f42aa830afe0dc6fe821a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.725123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e1b80533f42aa830afe0dc6fe821a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.735237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d55dc03-aae4-4e9f-8a77-fd2643f36700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e1b80533f42aa830afe0dc6fe821a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:52.762235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 965/1942] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:52 2022] DELETE /identity/v3/users/048e1b80533f42aa830afe0dc6fe821a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:53.133487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.180132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32551b1d-a51b-44c4-bc94-d1cf1ef50912 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:53.299250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:53.312277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:53.312927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.313196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.313465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] PATH_INFO: `/v3/projects/a4e74a700251442eb68b434828c00db3` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.314613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e74a700251442eb68b434828c00db3)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:53.316666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:53.391092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e74a700251442eb68b434828c00db3', 'request_id': 'req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.402599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e74a700251442eb68b434828c00db3', 'request_id': 'req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.410591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e74a700251442eb68b434828c00db3', 'request_id': 'req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.428681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] The token cache is being invalidate because project a4e74a700251442eb68b434828c00db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:53.429131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.431185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f1e8fc0a-b32f-43e8-ab48-9fc21bc9ad9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.432952 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 978/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:53 2022] DELETE /identity/v3/projects/a4e74a700251442eb68b434828c00db3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:53.438883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.439556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.439556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.461740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:53.463162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:53.570837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 966/1944] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:53.579939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.580375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.580771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.608890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:53.610273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:53.622855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 979/1945] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:53.626717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.634278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.635955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:53.640234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c995-45b8-49a9-ab2e-1b0ed747fb2b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:53.645247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:53.645858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.646131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.646399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.647299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:53.647639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:53.649278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:53.656097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80fdb3-0bc1-4abc-a857-409ab49e0666 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:53.661705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:53.662427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.662881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.663102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] PATH_INFO: `/v3/users/a0585a1b01814e039c6f9e7fb24e6ca5` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.664403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0585a1b01814e039c6f9e7fb24e6ca5)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:53.665242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 967/1946] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:53.666624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:53.670133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.680678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c336e0-eb43-4fea-8cf7-298550dd2b97 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:53.690204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:53.691713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.691995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.692266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.693526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:53.696784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:53.732071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0585a1b01814e039c6f9e7fb24e6ca5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.735270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 968/1947] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:53 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:53.739886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.742664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0585a1b01814e039c6f9e7fb24e6ca5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.743875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0585a1b01814e039c6f9e7fb24e6ca5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.744592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0585a1b01814e039c6f9e7fb24e6ca5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.764656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-091cebb4-14a8-4453-90e7-352609659c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0585a1b01814e039c6f9e7fb24e6ca5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:53.785991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 980/1948] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:53 2022] DELETE /identity/v3/users/a0585a1b01814e039c6f9e7fb24e6ca5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:53.790419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.790706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.791057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.815886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:53.817248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:53.874432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f5eb6-887d-45c7-9f93-8416f6b65bb6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:53.879614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:53.883191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:53.907794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 981/1949] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:53.915319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:53.916761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:53.991770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:53.992396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:53.992678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:53.993363 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:53.993586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:53.995587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.025015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f0199-e1da-4f67-a817-ba6f7b516fa5 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.036003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.036649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.036929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.037200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.037845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 969/1950] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:53 2022] POST /identity/v3/users => generated 291 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:54.046840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.053194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.055287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:54.055404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.073762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 982/1951] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:54.090978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb527a-bdb4-4f85-b742-55715ac05494 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.103508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.104580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.104860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.105655 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.106527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.117030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.145337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 970/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:54.146857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.176346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c157d-d8d7-45ec-bf7d-eb12300aa001 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.198815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.199731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.200002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.200266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.201094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.203162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf64eb-5fea-4d0d-ab27-6c62774d1135 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.236583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 983/1953] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:54.240160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.257038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65dbe-723d-4638-9d02-0d3555ddd769 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.270524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.276038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.276344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.276621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] PATH_INFO: `/v3/projects/951d3c4b918d45bcb143ff5d3e6c7560/users/d3355d7e249c4c8ebd9d2ce8c155e1e7/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.313138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951d3c4b918d45bcb143ff5d3e6c7560, user_id=d3355d7e249c4c8ebd9d2ce8c155e1e7, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.317115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.351102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 971/1954] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:54 2022] PUT /identity/v3/projects/951d3c4b918d45bcb143ff5d3e6c7560/users/d3355d7e249c4c8ebd9d2ce8c155e1e7/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:54.364741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.365029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.365300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.465928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] MFA Rules not processed for user `d3355d7e249c4c8ebd9d2ce8c155e1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:54.467175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:54.629241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 984/1955] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:54.634547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.646709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.648770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:54.769988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bec9e-6ee7-4032-bd5f-571e9afe85a9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.776693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.777492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.777779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.778055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.778702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.780722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.797522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e12058-f849-4ef9-bf4e-a47369b79f84 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.806930 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:54.808145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:54.810353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:54.811150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] PATH_INFO: `/v3/projects/a537f74c8a4e4449bf40dff6a57b6f7e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:54.813574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a537f74c8a4e4449bf40dff6a57b6f7e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:54.816090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:54.819108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 972/1956] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:54 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:54.822875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.842418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:54.908211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:54.920435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a537f74c8a4e4449bf40dff6a57b6f7e', 'request_id': 'req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:54.931371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a537f74c8a4e4449bf40dff6a57b6f7e', 'request_id': 'req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:54.939191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a537f74c8a4e4449bf40dff6a57b6f7e', 'request_id': 'req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:54.942330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b186eeb-7f75-413b-bab9-e7f6126511f9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:54.953377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] The token cache is being invalidate because project a537f74c8a4e4449bf40dff6a57b6f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:54.953855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:54.954565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:54.959024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 985/1957] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:54 2022] DELETE /identity/v3/projects/a537f74c8a4e4449bf40dff6a57b6f7e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:54.960911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:54.962273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.041269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.041891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.042167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.042439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.043107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.045110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.064289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024553b-ac3e-4cdd-b7df-9112ce4b5fd1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.070578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 973/1958] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:54 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:55.071011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.071695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.071983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.072244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] PATH_INFO: `/v3/users/d45f3a0a68b54ad8a88c842ee57ad649` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.073420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45f3a0a68b54ad8a88c842ee57ad649)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.075205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.076210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.077132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.098184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362995d7-c5cf-492e-af96-8f3aa223e94a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.103038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.103774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.104117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.104450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.105208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.107127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.120827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 974/1959] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:55.126434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.141971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15146839-31e1-4bd7-8a37-2f11083c238c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.146628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45f3a0a68b54ad8a88c842ee57ad649'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.147517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.148226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.148631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.148747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] PATH_INFO: `/v3/projects/47484c95db894301aabbee8ee3ac0b7d/users/0ad15ae5d91f4be88467e760aff22dd7/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.158361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45f3a0a68b54ad8a88c842ee57ad649'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.160189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45f3a0a68b54ad8a88c842ee57ad649'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.160863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45f3a0a68b54ad8a88c842ee57ad649'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.167180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47484c95db894301aabbee8ee3ac0b7d, user_id=0ad15ae5d91f4be88467e760aff22dd7, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.171557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.196860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 975/1960] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:55 2022] PUT /identity/v3/projects/47484c95db894301aabbee8ee3ac0b7d/users/0ad15ae5d91f4be88467e760aff22dd7/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:06:55.201804 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.202715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45f3a0a68b54ad8a88c842ee57ad649'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.203708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.217828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 986/1961] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:06:54 2022] DELETE /identity/v3/users/d45f3a0a68b54ad8a88c842ee57ad649 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:55.309872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8e7a6-037f-4104-8e8b-ec4b4f7ad3b7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.386172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:55.396685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.397560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.398077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.398537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.399363 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.401156 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bdd2b-4ded-448d-9a7d-8528d7e0aa39 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.413096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 976/1962] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:55.417569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.429799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67b935-6950-40d1-ac19-3e825609d633 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.438359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.439359 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.439713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.440166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] PATH_INFO: `/v3/projects/47484c95db894301aabbee8ee3ac0b7d/users/0ad15ae5d91f4be88467e760aff22dd7/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.446653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47484c95db894301aabbee8ee3ac0b7d, user_id=0ad15ae5d91f4be88467e760aff22dd7, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.449610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.462136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 987/1963] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:55 2022] PUT /identity/v3/projects/47484c95db894301aabbee8ee3ac0b7d/users/0ad15ae5d91f4be88467e760aff22dd7/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:55.473922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.474116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.474566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.508618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] MFA Rules not processed for user `0ad15ae5d91f4be88467e760aff22dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:55.509916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.600810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 977/1964] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:55.613766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.617117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.632005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:55.720991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5ab78-59e9-47c9-b91e-859ffe319c43 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.726768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.727962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.728250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.728545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.750454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.752101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.764982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 988/1965] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:06:55.798151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.800359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.868571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:55.878171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911b06c-fa8e-4643-929b-c3a09ecc0443 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.894568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.895647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.895647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.896082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.898632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:55.905891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a1947-8762-41b1-b983-e2a57518120b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:55.911059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:55.911737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:55.912321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:55.912608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] PATH_INFO: `/v3/projects/8c7727801453479b93c8b02113017fd6` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:55.914492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7727801453479b93c8b02113017fd6)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:55.915815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:55.982017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7727801453479b93c8b02113017fd6', 'request_id': 'req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.993228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7727801453479b93c8b02113017fd6', 'request_id': 'req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:55.999818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.001675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b6a5e-d964-4943-8423-9bf3e235a9f2 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.007206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7727801453479b93c8b02113017fd6', 'request_id': 'req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:56.026340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] The token cache is being invalidate because project 8c7727801453479b93c8b02113017fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:06:56.026634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:56.027342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6e2e2b4c-5731-4a8f-ab71-8b9db8b089c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:06:56.032430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 978/1966] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:06:55 2022] DELETE /identity/v3/projects/8c7727801453479b93c8b02113017fd6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:56.033786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.034066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.034339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.037537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 989/1967] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:06:56.050381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:56.057938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:56.060672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:56.222735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 979/1968] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:56.229747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.230032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.230385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.271410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:56.272515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:56.291068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 990/1969] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:56.292682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.309692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e030c0-b202-4aea-bff8-69504d1196ae None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.316636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.318158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.318568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.319637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.320821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:06:56.321775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.325590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.347366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 980/1970] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:06:56.357146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.367559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4103845-f02b-46f1-9da2-ac3276da3998 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.378762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.380015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.380457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.381034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.382412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.396440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.474342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 991/1971] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:56.475510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.485947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cf275-48ce-4d83-8506-2745c9b3cd28 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.560861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.561618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.561901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.562192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.563011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.564962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.587408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 981/1972] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:06:56.592465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.605940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888d02-b2c3-4d93-ad06-f027c5370764 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.611206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.612131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.612476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.612815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.613476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.615104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.630662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 992/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:56.632026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.642428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260501c-6cf8-4e07-8cf6-744babca809c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.647813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.648444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.648718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.648983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.649845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.651632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cad52-d168-46e1-8910-37e47f0f1eb5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.669404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 982/1974] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:06:56.670684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.681282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f81df-6fa7-4237-841d-4a41f3f5e952 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.687220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.687934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.688211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.688482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] PATH_INFO: `/v3/projects/e4b618f42a1e4ab8adcf9632d7744347/users/41c7020c7995408d826375eefbf0a8a8/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.704578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b618f42a1e4ab8adcf9632d7744347, user_id=41c7020c7995408d826375eefbf0a8a8, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.707243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:56.724417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 993/1975] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:56 2022] PUT /identity/v3/projects/e4b618f42a1e4ab8adcf9632d7744347/users/41c7020c7995408d826375eefbf0a8a8/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:56.737389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.737974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.738281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.771556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] MFA Rules not processed for user `41c7020c7995408d826375eefbf0a8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:56.772854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:56.881328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 983/1976] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:56.887088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:56.947384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:56.964353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24c444-de68-4fb2-9c50-154c716d6659 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:56.970041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:56.970781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:56.971091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:56.971335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:56.972043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:56.974222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.007883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 994/1977] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:06:56 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:57.011993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.017560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:06:57.024859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584c82-af9a-4b30-927c-4b045ed0838f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.092206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.093023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.093302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.093583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.094316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.097052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.122284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 984/1978] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:06:57 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:06:57.126500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.138274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e667caa-b45b-4442-ae31-f75f8a044b56 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.143605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.144223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.144507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.144776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.145422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.147090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.163969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 995/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:57.165140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.176127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bd9db-9363-441d-b115-0ff52f505f24 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.181162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.181908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.182259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.182606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] PATH_INFO: `/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c/users/74cba87904194716b0502771d0637be1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.200690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbdf27a27b645219ce4b52d9ac9d39c, user_id=74cba87904194716b0502771d0637be1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.204057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.222149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 985/1980] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:57 2022] PUT /identity/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c/users/74cba87904194716b0502771d0637be1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:57.227587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.240649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec41e8-a571-4bbb-ad7f-6c316c223bea admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.333513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.334358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.334496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.334769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.335413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.337086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8d43-ff41-4051-abd0-50496ce97889 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.352634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 996/1981] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:06:57.357327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.372444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913dc18-05d0-4e24-a74f-3c54d4eb0e01 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.385552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.391115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.391408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.391871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] PATH_INFO: `/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c/users/74cba87904194716b0502771d0637be1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.394164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbdf27a27b645219ce4b52d9ac9d39c, user_id=74cba87904194716b0502771d0637be1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.397036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.431813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 986/1982] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:06:57 2022] PUT /identity/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c/users/74cba87904194716b0502771d0637be1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:06:57.435557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.436110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.436261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.474795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] MFA Rules not processed for user `74cba87904194716b0502771d0637be1`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:06:57.476156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:57.608663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 997/1983] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:06:57.620406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:06:57.624682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:06:57.700207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951113-c1fc-4869-bbfa-5609bd2a0cd6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:06:57.707956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:06:57.708666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:06:57.709009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:06:57.709348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:06:57.795703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:06:57.797383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:06:57.807768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 987/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:02.369133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:02.370546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:02.384721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644373f-6b1f-41da-9199-c030384bc5f6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:02.389682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:02.390400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:02.390629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:02.390904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:02.400886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:02.403151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ce86-87c3-4620-86f5-cdb68f436dfe service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:02.414530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 998/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:03.515667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:03.517755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:03.530732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:03.596445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48004d8e-7cd4-4691-8793-6b2feba4e6ae service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:03.600758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:03.601377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:03.601653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:03.601933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] PATH_INFO: `/v3/users/d3355d7e249c4c8ebd9d2ce8c155e1e7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:03.603048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3355d7e249c4c8ebd9d2ce8c155e1e7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:03.605659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:03.653014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3355d7e249c4c8ebd9d2ce8c155e1e7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:03.660518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3355d7e249c4c8ebd9d2ce8c155e1e7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:03.661278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3355d7e249c4c8ebd9d2ce8c155e1e7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:03.661929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3355d7e249c4c8ebd9d2ce8c155e1e7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:03.669995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3355d7e249c4c8ebd9d2ce8c155e1e7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:03.688425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 988/1986] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:03 2022] DELETE /identity/v3/users/d3355d7e249c4c8ebd9d2ce8c155e1e7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:03.692776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:03.693261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:03.693540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:03.716343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:03.717575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:03.743495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:03.785522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 999/1987] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:03.798932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:03.800960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:03.867548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17419ba-f94a-4c0c-95c7-9f97c3f55b18 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:03.871250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:03.871894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:03.872548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:03.872548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:03.883353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:03.884847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:03.902562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 989/1988] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:04.223567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:04.225245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:04.242405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ef71-4bbf-41f5-ab6d-435f96945f3f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:04.247783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:04.248643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:04.248852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:04.249127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] PATH_INFO: `/v3/projects/951d3c4b918d45bcb143ff5d3e6c7560` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:04.250508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951d3c4b918d45bcb143ff5d3e6c7560)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:04.252591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:04.319900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951d3c4b918d45bcb143ff5d3e6c7560', 'request_id': 'req-905f256f-51cb-43e3-8819-4059c9a6af16'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.328538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951d3c4b918d45bcb143ff5d3e6c7560', 'request_id': 'req-905f256f-51cb-43e3-8819-4059c9a6af16'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.336013 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951d3c4b918d45bcb143ff5d3e6c7560', 'request_id': 'req-905f256f-51cb-43e3-8819-4059c9a6af16'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.351148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] The token cache is being invalidate because project 951d3c4b918d45bcb143ff5d3e6c7560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:04.351517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.352173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.353729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1000/1989] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:04 2022] DELETE /identity/v3/projects/951d3c4b918d45bcb143ff5d3e6c7560 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:04.358199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:04.371742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41600be-e842-4a25-b80a-c75ec71d47e6 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:04.415540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:04.455599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:04.455599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:04.455599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:04.455599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] PATH_INFO: `/v3/users/0ad15ae5d91f4be88467e760aff22dd7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:04.456775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad15ae5d91f4be88467e760aff22dd7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:04.458735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:04.510552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad15ae5d91f4be88467e760aff22dd7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.519038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad15ae5d91f4be88467e760aff22dd7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.519961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad15ae5d91f4be88467e760aff22dd7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.520666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad15ae5d91f4be88467e760aff22dd7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.529592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d78ec13-4e5f-4429-961c-f0a5ca6e1490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad15ae5d91f4be88467e760aff22dd7'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.549738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 990/1990] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:04 2022] DELETE /identity/v3/users/0ad15ae5d91f4be88467e760aff22dd7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:04.837514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:04.839030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:04.856036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f256f-51cb-43e3-8819-4059c9a6af16 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:04.922575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:04.923235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:04.923663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:04.923948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] PATH_INFO: `/v3/projects/47484c95db894301aabbee8ee3ac0b7d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:04.925266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47484c95db894301aabbee8ee3ac0b7d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:04.927150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:04.982274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47484c95db894301aabbee8ee3ac0b7d', 'request_id': 'req-3e0bcab7-af70-455d-a9ed-c70126995e2d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:04.987405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:04.992937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47484c95db894301aabbee8ee3ac0b7d', 'request_id': 'req-3e0bcab7-af70-455d-a9ed-c70126995e2d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:05.000916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47484c95db894301aabbee8ee3ac0b7d', 'request_id': 'req-3e0bcab7-af70-455d-a9ed-c70126995e2d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:05.012755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] The token cache is being invalidate because project 47484c95db894301aabbee8ee3ac0b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:05.013065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:05.013714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e0bcab7-af70-455d-a9ed-c70126995e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:05.015272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1001/1991] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:04 2022] DELETE /identity/v3/projects/47484c95db894301aabbee8ee3ac0b7d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:05.020169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.020456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.020731 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.040839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:05.042069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:05.103922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 991/1992] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:05.113386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.113667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.113937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.137797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:05.139009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:05.146879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1002/1993] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:05.151314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.161758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f8650-a872-4aad-b4c2-fa143c59a48e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.166344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.166943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.167214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.168128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.168769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:05.169070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.170866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.183621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 992/1994] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:05.187987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.197306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb3e4f-80f5-4755-b377-c699f56aa54c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.202158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.203029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.203029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.203342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.203965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.205904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.240294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1003/1995] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:05.242992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.254974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa53b-2aff-454f-99c9-e3ab3c05cdad admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.306544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:05.334359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.335005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.335286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.335582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.336212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.338245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.374466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 993/1996] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:05.375782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.388503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad101f3-6d96-4c35-b422-5e3013102fb0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.393925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.394806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.395719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.396090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.396835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.398646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.427842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1004/1997] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:05.432158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.443509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53450926-583c-45c6-aa06-2c4f3eb3ada4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.451944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.452606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.452885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.453237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.454074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.456028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b9d95-e5f2-4169-9ccf-2bab69232bc2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.468332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 994/1998] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:05.472546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.502600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa944-6f3f-4e1a-81ac-4cf6c5a70218 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.534393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.534393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.534393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.534393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] PATH_INFO: `/v3/projects/37dad17cc33141d0a3fdc3660f42c7c1/users/ebca03568112484c9f129604bfa03d0c/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.547629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dad17cc33141d0a3fdc3660f42c7c1, user_id=ebca03568112484c9f129604bfa03d0c, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.550477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.565454 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1005/1999] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:05 2022] PUT /identity/v3/projects/37dad17cc33141d0a3fdc3660f42c7c1/users/ebca03568112484c9f129604bfa03d0c/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:05.577699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.578239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.578387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.624001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] MFA Rules not processed for user `ebca03568112484c9f129604bfa03d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:05.626071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:05.699771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 995/2000] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:05.705060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.771922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f01132-10be-408d-9cf5-d29e7d46ac01 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.776580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.777387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.777695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.778197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.778620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.780640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.809119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1006/2001] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:05.813160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.824685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa715b64-b3b5-4d5e-8127-f6eef0bbbf95 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.884607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.885365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.885610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.885924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.887183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.889374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.912204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 996/2002] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:05 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:05.914225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.926529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e28a22-cdf3-4746-b63c-3dee9176eb26 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.932091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.933476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.933795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.934015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.934750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.936405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:05.947380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1007/2003] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:05.952293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:05.962779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d96d6-decf-40d6-aa4a-e1dfde318504 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:05.973791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:05.974824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:05.975106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:05.975382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] PATH_INFO: `/v3/projects/bf9e975a6d694567a5393cd9a65f2736/users/b643df5e1b2540f8a787ec7da4bd832d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:05.990610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9e975a6d694567a5393cd9a65f2736, user_id=b643df5e1b2540f8a787ec7da4bd832d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:05.993833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:06.007140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 997/2004] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:05 2022] PUT /identity/v3/projects/bf9e975a6d694567a5393cd9a65f2736/users/b643df5e1b2540f8a787ec7da4bd832d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:06.012226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:06.023394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a5dd5-dcb3-47e9-9330-5b655b61403d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:06.071333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:06.082457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:06.083097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:06.083373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:06.083673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:06.084310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:06.085915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5d6c7-86fd-47e9-9252-7eff6618b4db admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:06.095798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1008/2005] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:06.100131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:06.111212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c9931-a2fd-4f52-b0aa-395d941ac025 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:06.116763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:06.117423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:06.118163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:06.118600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] PATH_INFO: `/v3/projects/bf9e975a6d694567a5393cd9a65f2736/users/b643df5e1b2540f8a787ec7da4bd832d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:06.121216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9e975a6d694567a5393cd9a65f2736, user_id=b643df5e1b2540f8a787ec7da4bd832d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:06.123976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:06.129856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:06.137074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 998/2006] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:06 2022] PUT /identity/v3/projects/bf9e975a6d694567a5393cd9a65f2736/users/b643df5e1b2540f8a787ec7da4bd832d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:06.147444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618766-be44-4a02-932c-f6730db152ee None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:06.147755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618766-be44-4a02-932c-f6730db152ee None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:06.148029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618766-be44-4a02-932c-f6730db152ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:06.181034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-45618766-be44-4a02-932c-f6730db152ee None None] MFA Rules not processed for user `b643df5e1b2540f8a787ec7da4bd832d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:06.182307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-45618766-be44-4a02-932c-f6730db152ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:06.255121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1009/2007] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:06.267173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:06.269288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:06.329384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157941ba-60cf-4771-afca-893b9d35da95 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:06.333043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:06.333650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:06.333929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:06.334200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:06.343398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:06.344948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:06.357001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 999/2008] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:06.437460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618766-be44-4a02-932c-f6730db152ee None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:06.438907 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-45618766-be44-4a02-932c-f6730db152ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:06.451849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618766-be44-4a02-932c-f6730db152ee None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:06.455619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:06.456222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:06.456575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:06.456754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:06.525960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:06.528204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3360-b96e-43d1-9c13-4e8e94ecf70f service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:06.538285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1010/2009] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:07.595503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:07.597037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:07.688579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60e457-e0ed-4d52-9df6-32011bfa56e4 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:07.701171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:07.701967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:07.702588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:07.702588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] PATH_INFO: `/v3/users/41c7020c7995408d826375eefbf0a8a8` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:07.703627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c7020c7995408d826375eefbf0a8a8)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:07.705630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:07.783808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c7020c7995408d826375eefbf0a8a8'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:07.793079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c7020c7995408d826375eefbf0a8a8'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:07.793942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c7020c7995408d826375eefbf0a8a8'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:07.794728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c7020c7995408d826375eefbf0a8a8'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:07.803130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c7020c7995408d826375eefbf0a8a8'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:07.834149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1000/2010] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:07 2022] DELETE /identity/v3/users/41c7020c7995408d826375eefbf0a8a8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:07.838600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:07.839071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:07.839213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:07.862648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:07.864101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:07.988463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1011/2011] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:08.000003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:08.001469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:08.031254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:08.102641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2f8a-7aee-420c-9646-195986c77bdf admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:08.107149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:08.107796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:08.108116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:08.115837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:08.130379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:08.131998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:08.172227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1001/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:08.752597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:08.754036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:08.767593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e568026-298e-488c-b5e7-6a739ef203da None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:08.772591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:08.773378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:08.773683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:08.774037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] PATH_INFO: `/v3/projects/e4b618f42a1e4ab8adcf9632d7744347` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:08.775297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b618f42a1e4ab8adcf9632d7744347)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:08.777679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:08.787983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:08.832569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b618f42a1e4ab8adcf9632d7744347', 'request_id': 'req-861a5133-264e-4385-93a9-7e95b6e2f0b4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:08.840994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b618f42a1e4ab8adcf9632d7744347', 'request_id': 'req-861a5133-264e-4385-93a9-7e95b6e2f0b4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:08.847318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b618f42a1e4ab8adcf9632d7744347', 'request_id': 'req-861a5133-264e-4385-93a9-7e95b6e2f0b4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:08.858810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] The token cache is being invalidate because project e4b618f42a1e4ab8adcf9632d7744347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:08.859093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:08.859857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:08.861502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1012/2013] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:08 2022] DELETE /identity/v3/projects/e4b618f42a1e4ab8adcf9632d7744347 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:08.865664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:08.876590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358cec-8de4-4a83-9a78-8e370a49540f service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:08.952306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:08.953325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:08.953817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:08.954223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] PATH_INFO: `/v3/users/74cba87904194716b0502771d0637be1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:08.957567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cba87904194716b0502771d0637be1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:08.958540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:09.026848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cba87904194716b0502771d0637be1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.037702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cba87904194716b0502771d0637be1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.038537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cba87904194716b0502771d0637be1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.039296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cba87904194716b0502771d0637be1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.048986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-70e5435c-bbbc-449b-812d-72856dbd0f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cba87904194716b0502771d0637be1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.074897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1002/2014] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:08 2022] DELETE /identity/v3/users/74cba87904194716b0502771d0637be1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:09.495396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:09.497274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:09.533802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5133-264e-4385-93a9-7e95b6e2f0b4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:09.625424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:09.626461 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:09.627073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:09.627680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] PATH_INFO: `/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:09.629107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbdf27a27b645219ce4b52d9ac9d39c)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:09.631902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:09.698290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbdf27a27b645219ce4b52d9ac9d39c', 'request_id': 'req-505c6c47-5734-4646-a765-fea11b54f485'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.709912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbdf27a27b645219ce4b52d9ac9d39c', 'request_id': 'req-505c6c47-5734-4646-a765-fea11b54f485'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.717878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbdf27a27b645219ce4b52d9ac9d39c', 'request_id': 'req-505c6c47-5734-4646-a765-fea11b54f485'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.732327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] The token cache is being invalidate because project 0cbdf27a27b645219ce4b52d9ac9d39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:09.732678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.733455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-505c6c47-5734-4646-a765-fea11b54f485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:09.735576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1013/2015] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:09 2022] DELETE /identity/v3/projects/0cbdf27a27b645219ce4b52d9ac9d39c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:09.741271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:09.742051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:09.742414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:09.800618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:09.802094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:09.875902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:09.928251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1003/2016] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:09.937022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:09.938099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:09.938601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:09.970410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:09.972178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:09.982519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1014/2017] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:09.986955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:09.996822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e555c47-3887-43f6-a3f0-df95ac058adb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.001383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.001995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.002266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.002537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.003269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:10.003565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.005286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.020625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1004/2018] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:10.025279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.035961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9782b3-5e7b-44a7-b3ba-d271c983f15c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.040924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.041472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.041756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.042159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.043148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.045318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.069874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:10.080901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1015/2019] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:10 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:10.085337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.096770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329bfc-2ae8-4cb1-845c-62d832d49fd9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.169488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.170781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.170781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.171002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.171769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.173915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.204795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1005/2020] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:10 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:10.205772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.217755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d207a-143b-42f8-92a9-2aa8e9874e28 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.224337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.224961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.225240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.225537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.226559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.228291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.266424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1016/2021] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:10.271242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.284537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ae866-650a-4352-bdd0-4302920ebf1c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.306920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.308975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.308975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.309240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.310650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.313876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf10b76-cb62-4b7a-ae45-104a769b6411 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.327611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1006/2022] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:10.331712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.342210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ce1c0-fc8e-4763-9a69-d1c202d2acc4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.347091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.347828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.348091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.348360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] PATH_INFO: `/v3/projects/9acc13136b65443bab66fc8b69df7c8c/users/9f3e5c3426164c97bed5ca15cc53e904/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.364990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9acc13136b65443bab66fc8b69df7c8c, user_id=9f3e5c3426164c97bed5ca15cc53e904, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.367673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.383625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1017/2023] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:10 2022] PUT /identity/v3/projects/9acc13136b65443bab66fc8b69df7c8c/users/9f3e5c3426164c97bed5ca15cc53e904/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:10.399506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.399758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.400028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.438993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] MFA Rules not processed for user `9f3e5c3426164c97bed5ca15cc53e904`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:10.440264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:10.536429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1007/2024] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:10.549836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.551830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:10.637055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2b9db-2db9-4056-81d4-3207462e4b61 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.640886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.641519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.641811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.642191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.653249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.654917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d476f-d02e-4ba6-8a39-265ce01c47e1 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.671394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1018/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:10.697305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:10.761771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:10.804966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885bb75-c865-4332-a344-b6040197f3e5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:10.828665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:10.829335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.829629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.829903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] PATH_INFO: `/v3/users/9f3e5c3426164c97bed5ca15cc53e904` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:10.840119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3e5c3426164c97bed5ca15cc53e904)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:10.843666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:10.922460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3e5c3426164c97bed5ca15cc53e904'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:10.931551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3e5c3426164c97bed5ca15cc53e904'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:10.933512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3e5c3426164c97bed5ca15cc53e904'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:10.934396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3e5c3426164c97bed5ca15cc53e904'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:10.944839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3e5c3426164c97bed5ca15cc53e904'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:10.973018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1008/2026] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:10 2022] DELETE /identity/v3/users/9f3e5c3426164c97bed5ca15cc53e904 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:10.977334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:10.977782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:10.978254 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:11.000730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:11.001966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:11.087384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1019/2027] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:11.097474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:11.098971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:11.206762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556ff2-abe5-4058-928e-e417d8ab4bc4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:11.211134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:11.211946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:11.212326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:11.213178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:11.224957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:11.227277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:11.251832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1009/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:11.416658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:11.419301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:11.438819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2aad-80a0-40dd-a097-5242df0ffe0a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:11.443806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:11.444457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:11.444730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:11.445002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] PATH_INFO: `/v3/users/db51c324fddc472c871b077167c903e4` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:11.446210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db51c324fddc472c871b077167c903e4)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:11.448404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:11.522386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db51c324fddc472c871b077167c903e4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:11.532835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db51c324fddc472c871b077167c903e4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:11.533562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db51c324fddc472c871b077167c903e4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:11.534182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db51c324fddc472c871b077167c903e4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:11.543529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:11.555418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db51c324fddc472c871b077167c903e4'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:11.573326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1020/2029] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:11 2022] DELETE /identity/v3/users/db51c324fddc472c871b077167c903e4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:11.788151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:11.806390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136297-7c71-4d6d-a5c7-455a5c8c2f66 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:11.826868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:11.828523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:11.896221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:11.896867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:11.898726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:11.899025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] PATH_INFO: `/v3/projects/44e8aaa875614f4a84557e6846f326f4` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:11.900313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e8aaa875614f4a84557e6846f326f4)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:11.902589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:11.904340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:11.983064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f15f-aa77-455e-bc9c-474cf8b94b7f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:11.992826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e8aaa875614f4a84557e6846f326f4', 'request_id': 'req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.001920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e8aaa875614f4a84557e6846f326f4', 'request_id': 'req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.008526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e8aaa875614f4a84557e6846f326f4', 'request_id': 'req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.021880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] The token cache is being invalidate because project 44e8aaa875614f4a84557e6846f326f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:12.022316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.023143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5e9dbaa1-50fc-456e-9f09-1f5fbe7e4470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.024759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1010/2030] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:11 2022] DELETE /identity/v3/projects/44e8aaa875614f4a84557e6846f326f4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:12.032074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fe0d-9c4d-4e15-9706-799a589f29dd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.032476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fe0d-9c4d-4e15-9706-799a589f29dd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.032845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0fe0d-9c4d-4e15-9706-799a589f29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.056867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1ab0fe0d-9c4d-4e15-9706-799a589f29dd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.058660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1ab0fe0d-9c4d-4e15-9706-799a589f29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.059933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.061002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.061491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.062072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] PATH_INFO: `/v3/projects/9acc13136b65443bab66fc8b69df7c8c` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.063387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9acc13136b65443bab66fc8b69df7c8c)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.065319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.068143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1011/2031] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:12.075884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.076165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.076432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.098928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.100301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.110087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1012/2032] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:12.114595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.122980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9acc13136b65443bab66fc8b69df7c8c', 'request_id': 'req-8cbd37e8-af16-4be6-94c3-c4e733f459bc'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.124565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8536ba-45a9-4df5-907e-fc1039ff0b9b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.130728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9acc13136b65443bab66fc8b69df7c8c', 'request_id': 'req-8cbd37e8-af16-4be6-94c3-c4e733f459bc'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.139128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9acc13136b65443bab66fc8b69df7c8c', 'request_id': 'req-8cbd37e8-af16-4be6-94c3-c4e733f459bc'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.151101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] The token cache is being invalidate because project 9acc13136b65443bab66fc8b69df7c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:12.151393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.152370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cbd37e8-af16-4be6-94c3-c4e733f459bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:12.154068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1021/2033] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:11 2022] DELETE /identity/v3/projects/9acc13136b65443bab66fc8b69df7c8c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:12.163084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba3c9-4305-408c-b3f6-fddb8c627e28 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.163373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba3c9-4305-408c-b3f6-fddb8c627e28 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.163756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cba3c9-4305-408c-b3f6-fddb8c627e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.186684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-01cba3c9-4305-408c-b3f6-fddb8c627e28 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.187968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-01cba3c9-4305-408c-b3f6-fddb8c627e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.194223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.194869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.195149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.195417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.196312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:12.196667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.198199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:12.198337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.212205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1013/2034] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:07:12.216842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.218802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.233114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1e389-42e0-4165-9350-6420093da186 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.238019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.238644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.238947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.239218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.239873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.241791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.254821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1022/2035] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:12.263566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.263982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.264265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.271864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1014/2036] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:12.275762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.286892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.288137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.330686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:12.349084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d25b96-0ac3-41cb-be67-5a0ce0178c1a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.350138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1023/2037] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:12.353802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.354406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.354518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.354963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.355336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.356002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.357929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.363377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d8528-b560-4d86-828f-ed4d901b7539 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.368099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.368702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.369276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.369276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.369869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:12.370337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.371868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.382964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1015/2038] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:12.383993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.387306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1024/2039] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:07:12.391537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.394169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92ced4-c1aa-4a17-9234-553921322aac admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.398979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.399610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.399891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.400161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.400802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.402740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597816af-5242-49cd-b7ff-0c4292879ee3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.403145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.408014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.408712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.409061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.409335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.409958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.411934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.413401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1016/2040] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:12.417365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.429700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc37f4-56d4-4a68-ac12-98cbfe947c4c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.437937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.439175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.439585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.440243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.441391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.445351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1025/2041] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:12.445493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.446356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.460718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1017/2042] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:12.465075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.488141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f915f-2a31-4845-a74a-2e30888d2796 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.524631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dc2fe-4dd8-4599-ad8b-1e6eac841923 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.531895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.532699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.533085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.533457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.534294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.536811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.564995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1026/2043] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/users => generated 281 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:12.566763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.566763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.567068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.567380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] PATH_INFO: `/v3/projects/003b7712d023485baf3891233ad2cb67/users/1c9de09d725f48db8cc9ac13a2ca3a52/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.569156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.586534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003b7712d023485baf3891233ad2cb67, user_id=1c9de09d725f48db8cc9ac13a2ca3a52, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.589805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a168-69d9-4ddf-98bb-d7ca1508afb2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.589927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e7f85-1da5-4c62-930b-094d641eec34 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.595122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.595868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.596273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.596701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.597384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.599267 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.603805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1018/2044] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:12 2022] PUT /identity/v3/projects/003b7712d023485baf3891233ad2cb67/users/1c9de09d725f48db8cc9ac13a2ca3a52/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:12.606115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:12.610382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.610691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.610966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.612217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:12.615345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.626352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9dcfe-2c83-49ad-982b-c1bb8981949e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.630957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.632228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.686326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.686915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.687250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.687560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.688229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.689793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.695699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1019/2046] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:12.701006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1028/2047] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:12.704999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.705136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.706748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.715408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f10800-86be-4b82-9d95-cd414e8f96d3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.720060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.720714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.720989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.721264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] PATH_INFO: `/v3/projects/16de85ca61f848c980e0dd02f32bc09a/users/dec97810c23044f7b6c54ecb6028c521/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.736650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16de85ca61f848c980e0dd02f32bc09a, user_id=dec97810c23044f7b6c54ecb6028c521, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.739316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1aa5-cf90-4051-9ef8-2f1ed7c4e967 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.752930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1020/2048] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:12 2022] PUT /identity/v3/projects/16de85ca61f848c980e0dd02f32bc09a/users/dec97810c23044f7b6c54ecb6028c521/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:12.764690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.764976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.765289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.768703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffeae6-975b-4846-9e00-6e4bcbaf32ca admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.793234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] MFA Rules not processed for user `dec97810c23044f7b6c54ecb6028c521`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:12.794486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.798708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:12.819768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.820391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.820665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.820932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.865006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1021/2049] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:12.876902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:12.878226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:12.884093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.885560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.895297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1029/2050] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:07:12.942009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c7a9a-0872-490f-9263-4f39aaffaaaf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:12.945711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:12.946307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:12.946583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:12.946852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:12.956365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:12.957810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb0b05-a650-4b47-b937-aa9499ceb05c service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:12.968815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1022/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:07:15.849414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:15.851261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:15.865814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:15.873323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f631-6f35-4408-b819-1838f23845b1 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:15.879227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:15.880105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:15.880491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:15.880860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] PATH_INFO: `/v3/users/ebca03568112484c9f129604bfa03d0c` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:15.883378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebca03568112484c9f129604bfa03d0c)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:15.886663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:15.976452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebca03568112484c9f129604bfa03d0c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:15.991174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebca03568112484c9f129604bfa03d0c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:15.992243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebca03568112484c9f129604bfa03d0c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:15.993052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebca03568112484c9f129604bfa03d0c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:16.010106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebca03568112484c9f129604bfa03d0c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:16.038377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1030/2052] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:15 2022] DELETE /identity/v3/users/ebca03568112484c9f129604bfa03d0c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:16.042340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:16.042845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:16.043048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:16.079495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:16.081433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:16.196210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1023/2053] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:16.206556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:16.208927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:16.377766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f8145-6735-4352-8743-82fba8321e96 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:16.402384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:16.404265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:16.404265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:16.404464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:16.416531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:16.419026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:16.431614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1031/2054] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:16.859340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:16.861682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:16.881503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8216f-bf2f-4ca2-9364-d6887d3fece8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:16.888978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:16.889991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:16.890212 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:16.890555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] PATH_INFO: `/v3/projects/37dad17cc33141d0a3fdc3660f42c7c1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:16.892581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dad17cc33141d0a3fdc3660f42c7c1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:16.896173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:16.966825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:16.975389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dad17cc33141d0a3fdc3660f42c7c1', 'request_id': 'req-7dd3619c-828d-4e78-9dac-3ce51d3c06da'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:16.987054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dad17cc33141d0a3fdc3660f42c7c1', 'request_id': 'req-7dd3619c-828d-4e78-9dac-3ce51d3c06da'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:16.995412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dad17cc33141d0a3fdc3660f42c7c1', 'request_id': 'req-7dd3619c-828d-4e78-9dac-3ce51d3c06da'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.018203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] The token cache is being invalidate because project 37dad17cc33141d0a3fdc3660f42c7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:17.018875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.020900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.023091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1024/2055] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:16 2022] DELETE /identity/v3/projects/37dad17cc33141d0a3fdc3660f42c7c1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:17.028040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:17.043004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eec6db-8db3-47f3-bbda-d5b2267d9a4c service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:17.145114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:17.145877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:17.146231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:17.146577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] PATH_INFO: `/v3/users/b643df5e1b2540f8a787ec7da4bd832d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:17.147842 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b643df5e1b2540f8a787ec7da4bd832d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:17.149938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:17.181298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:17.222594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b643df5e1b2540f8a787ec7da4bd832d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.237591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b643df5e1b2540f8a787ec7da4bd832d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.238395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b643df5e1b2540f8a787ec7da4bd832d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.239142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b643df5e1b2540f8a787ec7da4bd832d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.258446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-776c3093-9b98-4469-8d12-ba5ccea99670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b643df5e1b2540f8a787ec7da4bd832d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.278896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1032/2056] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:17 2022] DELETE /identity/v3/users/b643df5e1b2540f8a787ec7da4bd832d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:17.391808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:17.393375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:17.415052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3619c-828d-4e78-9dac-3ce51d3c06da admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:17.505157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:17.506011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:17.506852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:17.507157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] PATH_INFO: `/v3/users/01df1a161ca74281b3a8a622d5776b17` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:17.509241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01df1a161ca74281b3a8a622d5776b17)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:17.512234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:17.568126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01df1a161ca74281b3a8a622d5776b17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.578460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01df1a161ca74281b3a8a622d5776b17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.579591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01df1a161ca74281b3a8a622d5776b17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.580365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01df1a161ca74281b3a8a622d5776b17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.591661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01df1a161ca74281b3a8a622d5776b17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:17.616615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1025/2057] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:17 2022] DELETE /identity/v3/users/01df1a161ca74281b3a8a622d5776b17 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:17.624692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:17.624991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:17.625271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:17.646810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:17.648066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:17.798000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1033/2058] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:17.815307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:17.818701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:17.946246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ea93-27dc-49c9-8e5c-122c88909f84 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:17.951355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:17.952015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:17.952592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:17.952951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:17.961876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:17.969563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:17.972230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b72f36-da0a-4859-aff8-1a0a7769dd4c service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:17.985387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1026/2059] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:18.086495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:18.088060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.112522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5476ef8-473b-4f3b-b1ec-1a97a0560f5d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:18.122230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:18.123828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.124392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.125519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] PATH_INFO: `/v3/projects/bf9e975a6d694567a5393cd9a65f2736` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.128178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9e975a6d694567a5393cd9a65f2736)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:18.134083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:18.288645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9e975a6d694567a5393cd9a65f2736', 'request_id': 'req-4069a778-942f-480a-82cf-2493580e5b67'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.316189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9e975a6d694567a5393cd9a65f2736', 'request_id': 'req-4069a778-942f-480a-82cf-2493580e5b67'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.332418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9e975a6d694567a5393cd9a65f2736', 'request_id': 'req-4069a778-942f-480a-82cf-2493580e5b67'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.383968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] The token cache is being invalidate because project bf9e975a6d694567a5393cd9a65f2736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:18.384432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.385700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4069a778-942f-480a-82cf-2493580e5b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.407734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1034/2060] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:18 2022] DELETE /identity/v3/projects/bf9e975a6d694567a5393cd9a65f2736 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:18.412986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.412986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.412986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.417349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.417772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.422685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.458271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] MFA Rules not processed for user `1c9de09d725f48db8cc9ac13a2ca3a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:18.459910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.498170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:18.499410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.548025 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:18.623515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1027/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 07 13:07:18.623515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:18.623515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.679669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1035/2062] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:18.680623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:18.682008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.739541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5476f-7493-4984-aec0-75e7a57f0ae3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:18.757557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:18.757812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.758078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.767819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] PATH_INFO: `/v3/projects/3c5806697686490cbbe9940593a56346` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.769383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c5806697686490cbbe9940593a56346)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:18.771946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:18.804765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17492ad2-b67d-4bbb-8357-9dfea1db677d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:18.814003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:18.814632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.814910 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.815179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.824567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:18.825912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b62267-b212-4b50-9ccf-1f09ba5b643d service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:18.836202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1036/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:18.845059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.846094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.846724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.854268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5806697686490cbbe9940593a56346', 'request_id': 'req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.868851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5806697686490cbbe9940593a56346', 'request_id': 'req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.873854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:18.875390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.879094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5806697686490cbbe9940593a56346', 'request_id': 'req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.893484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] The token cache is being invalidate because project 3c5806697686490cbbe9940593a56346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:18.893791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.894511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c6cdbf2-82c3-4fd0-b949-fb49a7d2d37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:18.896150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1028/2064] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:18 2022] DELETE /identity/v3/projects/3c5806697686490cbbe9940593a56346 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:18.901346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:18.901775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:18.902211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:18.934276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:18.935646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:18.949188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:19.003997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1037/2065] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:19.009015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.021163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb737d-0513-42e5-b9d5-34c2face7755 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.029626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.030458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.031001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.031001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.032066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:19.032066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.034272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736afe0-d24a-4eda-8369-d88faee19d1f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.048984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1029/2066] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:19.049447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1038/2067] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:19.061240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.064591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.065230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.065924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.075531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d05ba-8ad5-45ae-94fa-5655c5dd68de None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.081504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.082287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.083129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.083129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.084178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.086393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.128957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:19.132945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:19.145051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1039/2068] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:19.150580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.170417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1030/2069] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:19.173605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.201534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e099778-59c6-46ec-b542-50343996aa37 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.239109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:19.266925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca093b7-eaee-40d3-bf83-7ff3bfbf888d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.280254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.281348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.281777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.283364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.284564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.289023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.301575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.302289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.302833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.308058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.309346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:19.309744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.311649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.325610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1040/2070] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:07:19.330489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.343515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1031/2071] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:19.347799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb2f4e-63c2-4202-87bd-f5abaf65647d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.348638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.353087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.353721 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.354008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.354272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.355509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.359713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.373340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5b8e1-34dd-47f8-9b14-a654f1c418f9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.385926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.386780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.387263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.387439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.388142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.389793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.410332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1032/2072] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:19.411557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.427059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ed67-8313-4bff-94a2-e363ba0cb395 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.430142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1041/2073] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:19.434698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.553343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.557021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.557301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.557550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.559017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.560685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.572139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1033/2074] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:19.576811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.589296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b361749-cdec-4171-8f3c-dcb52bdc5c44 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.595573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d856e-e91f-405c-a74d-8c5c2e01a272 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.611305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.612184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.612631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.613053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] PATH_INFO: `/v3/projects/2ff08c8aac8d4a6f901931e96b614a20/users/77b0fce87e31408582300e5fae0f0ce9/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.613169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.613868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.614225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.615197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.615937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.620743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.631621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:19.656660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1042/2075] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:19.660557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.662214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff08c8aac8d4a6f901931e96b614a20, user_id=77b0fce87e31408582300e5fae0f0ce9, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.665998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00209072-4315-4ace-8ad2-5f263e19fcd2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.676499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173a1aa-ef9e-4902-9d90-5564f1d0eeba admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.691594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.691594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.691594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.691594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.692015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.706738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.710733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1034/2076] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:19 2022] PUT /identity/v3/projects/2ff08c8aac8d4a6f901931e96b614a20/users/77b0fce87e31408582300e5fae0f0ce9/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:19.713015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.713307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.713582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.727617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1043/2077] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:19.728874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.746412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39401c04-7a02-439c-bcb5-87b7d66bbf00 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.762963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] MFA Rules not processed for user `77b0fce87e31408582300e5fae0f0ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:19.764389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:19.856877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.857542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.857806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.863081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.864076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.866317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.879568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1044/2078] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:19.884331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.899936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1035/2079] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:19.902364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032709c7-36aa-47a5-a100-6eb2f571744e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.904814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:19.915898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.918125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.918926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.919386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] PATH_INFO: `/v3/projects/8df127830e9a4b13ac1f24172c2acbcc/users/4c97220a52184df0b5edc0413072b5b3/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.931811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea551a6-f8ad-4e99-b990-59a091f13549 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:19.938478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:19.943550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:19.944232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.946384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.946680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:19.948060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.950412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df127830e9a4b13ac1f24172c2acbcc, user_id=4c97220a52184df0b5edc0413072b5b3, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:19.953539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62bb54-280c-4317-81c4-5d0d23ae9b00 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.953940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:19.970689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1045/2080] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:19 2022] PUT /identity/v3/projects/8df127830e9a4b13ac1f24172c2acbcc/users/4c97220a52184df0b5edc0413072b5b3/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:19.986191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:19.986584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:19.986892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.018468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1036/2081] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:20.022515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.023140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] MFA Rules not processed for user `4c97220a52184df0b5edc0413072b5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:20.024543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:20.147324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1046/2082] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:20.165421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c04ef-d250-4712-8b62-9253f0a8f698 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.166243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.168660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:20.172167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.173070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.173573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.174044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.174891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.177746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.218373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1037/2083] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:20 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:20.220880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.234429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69e15a-d0eb-4979-a00b-b26cd868cec3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.239816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.241129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.241478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.241846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.242578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.244578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.245840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1f2c3-57d3-433e-b99d-19573f5bd478 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.252973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.254162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.254722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.255200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.257773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1038/2084] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:20.262741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.268529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.270260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.273193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197bcb-8cd2-4394-8d3e-11a0d693b29e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.278945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.279674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.279956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.280231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] PATH_INFO: `/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee/users/f69cbb8c712c4fb1a3a93063b63d1abf/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.282536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1047/2085] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:20.298667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7393bd1a4d41b58aee1db32bc1aeee, user_id=f69cbb8c712c4fb1a3a93063b63d1abf, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.301448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.318024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1039/2086] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:20 2022] PUT /identity/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee/users/f69cbb8c712c4fb1a3a93063b63d1abf/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:20.321638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.336301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000edfd-c9dd-4f69-be17-a6883cd69645 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.408799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.409413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.409727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.410045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.410801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.414010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba3fd-7379-456e-b2c7-aa785b2570e4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.424906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1048/2087] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:20.428643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.435685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:20.440184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc290c39-b0dd-46e5-b99c-edbea4c5903a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.447089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.447848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.448125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.448990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] PATH_INFO: `/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee/users/f69cbb8c712c4fb1a3a93063b63d1abf/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.450976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7393bd1a4d41b58aee1db32bc1aeee, user_id=f69cbb8c712c4fb1a3a93063b63d1abf, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.454439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.478007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1040/2088] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:20 2022] PUT /identity/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee/users/f69cbb8c712c4fb1a3a93063b63d1abf/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:20.478537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.478897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.479294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.529040 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] MFA Rules not processed for user `f69cbb8c712c4fb1a3a93063b63d1abf`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:20.530627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:20.547813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:20.746110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1049/2089] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:20.790169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:20.885125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6f60e-1360-4b71-9a9b-1438075738c3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:20.891321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:20.892528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:20.893255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:20.893722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:20.914651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:20.916290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e295ce-868a-4182-8f75-9a5188ef77cc service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:20.941438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1041/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:21.032355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:21.044784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa669-9532-4955-a126-913f432e7c16 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:21.048950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:21.049621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:21.049965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:21.050237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:21.086762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e93-6034-4b04-8a85-d1e10e59db01 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:21.087129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e93-6034-4b04-8a85-d1e10e59db01 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:21.087484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e93-6034-4b04-8a85-d1e10e59db01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:21.116567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8e334e93-6034-4b04-8a85-d1e10e59db01 None None] MFA Rules not processed for user `1c9de09d725f48db8cc9ac13a2ca3a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:21.119241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8e334e93-6034-4b04-8a85-d1e10e59db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:21.163286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:21.165169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:21.201640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1050/2091] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:21.311112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1042/2092] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:24.689679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:24.774544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f1631-44b7-45bd-864a-ff72560ea50c service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:24.782392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:24.783195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:24.783676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:24.784249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] PATH_INFO: `/v3/users/77b0fce87e31408582300e5fae0f0ce9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:24.785541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b0fce87e31408582300e5fae0f0ce9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:24.787654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:24.837640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:24.841922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b0fce87e31408582300e5fae0f0ce9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:24.851180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b0fce87e31408582300e5fae0f0ce9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:24.851892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b0fce87e31408582300e5fae0f0ce9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:24.852512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b0fce87e31408582300e5fae0f0ce9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:24.866821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b0fce87e31408582300e5fae0f0ce9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:24.880297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1051/2093] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:24 2022] DELETE /identity/v3/users/77b0fce87e31408582300e5fae0f0ce9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:24.884927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:24.886536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:24.886917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:24.908118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:24.909350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:24.975417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1043/2094] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:24.989821 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:24.992629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:25.084188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acd6fb-56bc-42e9-b91d-b0cd59f6b429 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:25.089840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:25.090665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:25.090978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:25.091363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:25.102600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:25.105214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:25.117473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1052/2095] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:25.505269 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:25.506514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:25.533105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f1330-cf05-40b5-b777-1a50be203d41 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:25.545926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:25.546567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:25.546874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:25.547140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] PATH_INFO: `/v3/projects/2ff08c8aac8d4a6f901931e96b614a20` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:25.548556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff08c8aac8d4a6f901931e96b614a20)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:25.551422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:25.600398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:25.615706 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff08c8aac8d4a6f901931e96b614a20', 'request_id': 'req-451e5fe7-f58e-469e-928d-0e8ebee38f3b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.629600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff08c8aac8d4a6f901931e96b614a20', 'request_id': 'req-451e5fe7-f58e-469e-928d-0e8ebee38f3b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.637863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff08c8aac8d4a6f901931e96b614a20', 'request_id': 'req-451e5fe7-f58e-469e-928d-0e8ebee38f3b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.671251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] The token cache is being invalidate because project 2ff08c8aac8d4a6f901931e96b614a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:25.671592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.672400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.675582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1044/2096] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:25 2022] DELETE /identity/v3/projects/2ff08c8aac8d4a6f901931e96b614a20 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:25.680223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:25.697089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa61752-441e-4ee8-a1e1-b5ab98a5a506 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:25.763218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:25.763911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:25.764264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:25.764525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] PATH_INFO: `/v3/users/f69cbb8c712c4fb1a3a93063b63d1abf` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:25.765979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69cbb8c712c4fb1a3a93063b63d1abf)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:25.767798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:25.825001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69cbb8c712c4fb1a3a93063b63d1abf'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.834783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69cbb8c712c4fb1a3a93063b63d1abf'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.835915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69cbb8c712c4fb1a3a93063b63d1abf'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.836692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69cbb8c712c4fb1a3a93063b63d1abf'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.847748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:25.854100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69cbb8c712c4fb1a3a93063b63d1abf'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:25.868674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1053/2097] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:25 2022] DELETE /identity/v3/users/f69cbb8c712c4fb1a3a93063b63d1abf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:26.171309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.173416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.184589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.186043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.188165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e5fe7-f58e-469e-928d-0e8ebee38f3b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.265444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86a2d9-6a90-47fc-923c-e5e2a5fc0055 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.270951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.271804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.272248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.272687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] PATH_INFO: `/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.273954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7393bd1a4d41b58aee1db32bc1aeee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.277239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.277378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.278021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.278370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.278715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] PATH_INFO: `/v3/users/4c97220a52184df0b5edc0413072b5b3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.280228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c97220a52184df0b5edc0413072b5b3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.282260 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.336185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7393bd1a4d41b58aee1db32bc1aeee', 'request_id': 'req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.338465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c97220a52184df0b5edc0413072b5b3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.348591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7393bd1a4d41b58aee1db32bc1aeee', 'request_id': 'req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.351614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c97220a52184df0b5edc0413072b5b3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.352997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c97220a52184df0b5edc0413072b5b3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.353835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c97220a52184df0b5edc0413072b5b3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.358174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7393bd1a4d41b58aee1db32bc1aeee', 'request_id': 'req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.362983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9d83bab2-b60b-40fe-a1f6-82c9f7922d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c97220a52184df0b5edc0413072b5b3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.372273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] The token cache is being invalidate because project 6c7393bd1a4d41b58aee1db32bc1aeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:26.372552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.373169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.374914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1054/2098] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:26 2022] DELETE /identity/v3/projects/6c7393bd1a4d41b58aee1db32bc1aeee => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:26.378474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.379381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.384668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1045/2099] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:26 2022] DELETE /identity/v3/users/4c97220a52184df0b5edc0413072b5b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:26.387636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a139-1986-45f6-add7-ed6864922c7f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.388025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a139-1986-45f6-add7-ed6864922c7f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.388313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888a139-1986-45f6-add7-ed6864922c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.410037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3888a139-1986-45f6-add7-ed6864922c7f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:26.411312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3888a139-1986-45f6-add7-ed6864922c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.456546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:26.458520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4ea20-1917-4cb2-8a8f-3ed3c16100a2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.481500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:26.492320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1046/2100] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:26.494915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67d03-e5b3-484a-b5b3-59f7dedfa8d3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.495382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67d03-e5b3-484a-b5b3-59f7dedfa8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.495824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a67d03-e5b3-484a-b5b3-59f7dedfa8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.525312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-46a67d03-e5b3-484a-b5b3-59f7dedfa8d3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:26.527137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-46a67d03-e5b3-484a-b5b3-59f7dedfa8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.549921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1047/2101] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:26.549921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.549921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.549921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.565976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.567015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.567296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.567613 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] PATH_INFO: `/v3/users/b24d6686fd6d4813b206133357e2c8e5` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.569009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24d6686fd6d4813b206133357e2c8e5)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.570218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:26.571446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.572607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.584383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1048/2102] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:26.584383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.586929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.661653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24d6686fd6d4813b206133357e2c8e5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.673378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24d6686fd6d4813b206133357e2c8e5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.674096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24d6686fd6d4813b206133357e2c8e5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.675235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24d6686fd6d4813b206133357e2c8e5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.693797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64445e4-04bc-492f-bb88-caf36935beb3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.708207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.708818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.709175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.709478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.717426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.734564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.736458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.745547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-efdf941f-3533-41c7-bcde-274f080c50e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24d6686fd6d4813b206133357e2c8e5'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:26.754722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1049/2103] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:26.755394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.757441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.781735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1055/2104] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:26 2022] DELETE /identity/v3/users/b24d6686fd6d4813b206133357e2c8e5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:26.786584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.786873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ba211-c56e-4ec1-895e-52cbdb75ca26 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.787246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.787717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.816586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:26.818119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.858850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.859577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.860151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.860431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.861081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:26.861952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.863907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.880568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1050/2105] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:26.885038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.907310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268b942-6074-493c-a7a0-d2ad727b91d4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:26.908680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1056/2106] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:26.916953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:26.917583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:26.917863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:26.918132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:26.918766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:26.920813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:26.922479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:26.923973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:26.966384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1051/2107] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:26.968483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.024638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:27.031651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:27.051750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f663384-ca33-476f-abf2-65aa7bad892c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.059203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.060044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.060427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.060802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.061632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.063830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.070379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec0fbc-a7d2-43bd-8891-d74823e4178c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.093312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1052/2108] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:26 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:27.097378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.111402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba705c-888d-4e9c-8981-5ce066cdb4c6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.117030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.117689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.118151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.118494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.119428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.122454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.137419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1053/2109] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:27.138852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.149427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934c0eb-8d53-4c0b-85e8-96cad5f4eb76 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.155016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.155788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.156279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.156610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.157334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.159681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.175356 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1054/2110] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:27.180413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.188394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.189043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.189423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.189897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.191884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101fba-25f1-44fe-8dcb-7bc02a9be13a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.197565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.198936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.199251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.199694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] PATH_INFO: `/v3/projects/ca4b2049b56b4ba4abd272ec301d2f65/users/57a1f5428be5461aa604f190c2c96ef3/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.203617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.205581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4b59d-ec42-43d8-93cf-65f6e30697b4 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.216213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4b2049b56b4ba4abd272ec301d2f65, user_id=57a1f5428be5461aa604f190c2c96ef3, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.218393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1057/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:27.218994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.242752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1055/2112] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:27 2022] PUT /identity/v3/projects/ca4b2049b56b4ba4abd272ec301d2f65/users/57a1f5428be5461aa604f190c2c96ef3/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:27.257541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.258185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.258638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.323354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] MFA Rules not processed for user `57a1f5428be5461aa604f190c2c96ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:27.325862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.360344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.362635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.438032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1058/2113] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:27.442765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.447845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c6e6-2567-4ba1-97b9-0508a6da7ef5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.453097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.453741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.454029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.454297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] PATH_INFO: `/v3/projects/8df127830e9a4b13ac1f24172c2acbcc` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.455440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df127830e9a4b13ac1f24172c2acbcc)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.457384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.457614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d6006-cc94-4554-9170-3f1b503e722e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.464511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.465610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.465610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.465816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.466421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.468599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.514180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df127830e9a4b13ac1f24172c2acbcc', 'request_id': 'req-49f4a308-d63d-4356-a5e0-2c9454bd61d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.515554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1059/2114] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:27.524736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.528487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df127830e9a4b13ac1f24172c2acbcc', 'request_id': 'req-49f4a308-d63d-4356-a5e0-2c9454bd61d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.537841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df127830e9a4b13ac1f24172c2acbcc', 'request_id': 'req-49f4a308-d63d-4356-a5e0-2c9454bd61d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.555749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] The token cache is being invalidate because project 8df127830e9a4b13ac1f24172c2acbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:27.556138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.556860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-49f4a308-d63d-4356-a5e0-2c9454bd61d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.558631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1056/2115] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:27 2022] DELETE /identity/v3/projects/8df127830e9a4b13ac1f24172c2acbcc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:27.563557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.563912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.564249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.587928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:27.590088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.610874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:27.625176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44730-d39a-4dcc-b986-6e351389e2dc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.632208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.632927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.633220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.633491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.634131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.638010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.651965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:27.668086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1060/2116] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:27.669812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.671819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.677144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1057/2117] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:27.678109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.679776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.686646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b1431-0270-4216-9699-f87cf2973b4e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.691572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.692440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.692788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.693134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] PATH_INFO: `/v3/projects/9d978c5eea6041f7891deb7cae66df22` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.694289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc79fb-4cd7-4aa9-859c-ae78f07f93e6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.694392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d978c5eea6041f7891deb7cae66df22)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.696420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.700238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.700846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.701117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.701523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.702259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.703885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c786-0692-4b4c-bbe0-3b143f544d3b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.714577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1058/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:27.715892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0413-8af3-41c7-9456-dfa59319ad5b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.716179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0413-8af3-41c7-9456-dfa59319ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.716454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d0413-8af3-41c7-9456-dfa59319ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.737293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-387d0413-8af3-41c7-9456-dfa59319ad5b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:27.738580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-387d0413-8af3-41c7-9456-dfa59319ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.747457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d978c5eea6041f7891deb7cae66df22', 'request_id': 'req-11d1f012-1aff-4433-87f1-88cdec05cea2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.756475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d978c5eea6041f7891deb7cae66df22', 'request_id': 'req-11d1f012-1aff-4433-87f1-88cdec05cea2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.763427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d978c5eea6041f7891deb7cae66df22', 'request_id': 'req-11d1f012-1aff-4433-87f1-88cdec05cea2'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.778963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] The token cache is being invalidate because project 9d978c5eea6041f7891deb7cae66df22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:27.778963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.779539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:27.781609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1061/2119] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:27 2022] DELETE /identity/v3/projects/9d978c5eea6041f7891deb7cae66df22 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:27.782450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.784114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.816372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1059/2120] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:27.817821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.819682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.821276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.849048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:27.850270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.863311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1060/2121] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:27.868394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.879727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c085-9e8e-4872-acf1-8360a07a8242 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.886168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.886882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.887233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.887537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.888195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:27.888499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.890128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46f94d-af7a-40bf-b80e-9763825aa4c9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.890419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1f012-1aff-4433-87f1-88cdec05cea2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:27.896942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:27.897366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.898005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.903288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] PATH_INFO: `/v3/projects/70ace1f930364998bafb75f6231471de/users/1ad9a3f430164cc28acc44dc5aa70780/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.911235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1061/2122] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:27.911235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:27.911235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:27.911235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:27.922534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ace1f930364998bafb75f6231471de, user_id=1ad9a3f430164cc28acc44dc5aa70780, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:27.927063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:27.933953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:27.935198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:27.943440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1062/2123] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:27.944538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1062/2124] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:27 2022] PUT /identity/v3/projects/70ace1f930364998bafb75f6231471de/users/1ad9a3f430164cc28acc44dc5aa70780/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:27.947753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.947978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:27.958209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8a636-f097-4fd9-b04e-72be5b7685f7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.027667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.028421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.028766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.029120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.029823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.032174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.037668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825577-f866-44a0-a53a-75e384d25667 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.045839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.046583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.046964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.047336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.048369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:28.048773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.051120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.054769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:28.069232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1063/2125] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:27 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:28.070371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.081858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:28.097221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1063/2126] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:28.098242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.114400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cb3b4-754a-498c-9470-da21c10bf3c1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.163740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0a6b1-2aa8-4793-816a-4463375e3173 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.171351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.172014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.172297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.172569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.173221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.175174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.192561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1064/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:28.196406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.205618 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec085b1-279b-49c4-9c4c-8ed33fb53ba3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.210725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.211322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.211599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.211874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.212658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.215927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.217197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.217938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.218292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.218672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.220105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.222731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.253625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1065/2128] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:28.257807 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.270693 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1064/2129] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/users => generated 281 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:28.271694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.283824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7840-2441-49f2-83da-7046be93e4d0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.373373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a071cc-ee43-45dd-adb5-5891a90d9196 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.378583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.379528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.379885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.380224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] PATH_INFO: `/v3/projects/70ace1f930364998bafb75f6231471de/users/1ad9a3f430164cc28acc44dc5aa70780/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.381393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.382223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.382584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.382841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ace1f930364998bafb75f6231471de, user_id=1ad9a3f430164cc28acc44dc5aa70780, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.382992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.384052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.386996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.392442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a58bf9-f56a-4c59-a91d-4ade57c8006e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.410752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1066/2130] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:28 2022] PUT /identity/v3/projects/70ace1f930364998bafb75f6231471de/users/1ad9a3f430164cc28acc44dc5aa70780/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:28.411634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.429718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1065/2131] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:28.430844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.431123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.431394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.483407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] MFA Rules not processed for user `1ad9a3f430164cc28acc44dc5aa70780`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:28.484755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:28.503282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a8085-3d59-443f-8c5d-8770d00d8046 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.513248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.514512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.514718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.515053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.515736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.520431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.535612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1067/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:28.535612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.545611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24d2f9-2b61-48bb-b662-ba82090ca6b5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.550513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.551107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.551436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.551743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.552403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.553987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.560365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:28.560524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:28.564937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1066/2133] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:28.565809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.571409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1068/2134] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:28.572159 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.579681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a883ad3-16f6-4972-8031-cb99e9fc39f8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.583092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee349d-c1c9-4f90-98d9-63481cfd5928 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.584230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.584827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.585102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.585371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.586008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.587604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.587710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.588287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.588744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.589111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.589942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.591533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.599804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1067/2135] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:28.600663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.605295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:28.609130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1069/2136] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:28.610579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.623926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a9-0d71-46d8-b44e-f77362913c8d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.629049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.629738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.630021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.630301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] PATH_INFO: `/v3/projects/e28af5c0e75a4d7d80d5fa7bf57b2cca/users/27529e1a19e0447f820d08bdc0885dc4/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.648079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28af5c0e75a4d7d80d5fa7bf57b2cca, user_id=27529e1a19e0447f820d08bdc0885dc4, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.650780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.665327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1070/2137] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:28 2022] PUT /identity/v3/projects/e28af5c0e75a4d7d80d5fa7bf57b2cca/users/27529e1a19e0447f820d08bdc0885dc4/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:28.669140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820782d8-0d17-4501-af7b-5ad7fbd686e7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.670143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.725898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.726614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.726896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.727167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.738251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7a37d-d1d6-47cc-b932-ea2bac3ce452 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:28.742993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:28.743675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.743957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.744229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] PATH_INFO: `/v3/projects/7d13ee19e62a419c95dc553c53c28625/users/048ae7326970467887b939ebcafa1820/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.764092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d13ee19e62a419c95dc553c53c28625, user_id=048ae7326970467887b939ebcafa1820, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.767020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487671-772e-4f79-95be-0632b4be9c87 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.785521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1071/2138] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:28 2022] PUT /identity/v3/projects/7d13ee19e62a419c95dc553c53c28625/users/048ae7326970467887b939ebcafa1820/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:28.786770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.787054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.787328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.797843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:28.799988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca973-f531-4094-9d6f-910483730856 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:28.811065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1068/2139] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:28.812490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:28.812781 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:28.813187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:28.819266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] MFA Rules not processed for user `27529e1a19e0447f820d08bdc0885dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:28.820524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:28.852978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] MFA Rules not processed for user `048ae7326970467887b939ebcafa1820`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:28.854740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:28.914260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:28.922868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1072/2140] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:28.923732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.944920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1069/2141] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:28.959206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:28.973734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:29.000997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf60e-1995-4af9-955f-b71d28ec5af3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.005644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.006271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.006549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.006884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] PATH_INFO: `/v3/users/57a1f5428be5461aa604f190c2c96ef3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.008045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a1f5428be5461aa604f190c2c96ef3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.009977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.020082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b881-e543-40dd-97eb-6b1178fc0f4b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.023835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.024435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.024718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.024987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.034349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.035808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.047007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1070/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:07:29.047931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.049409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.063066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819dcc-f924-4ff0-a1bd-c5cb10a034b5 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.068030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a1f5428be5461aa604f190c2c96ef3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.068169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.068719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.069043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.069323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.081431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a1f5428be5461aa604f190c2c96ef3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.081431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a1f5428be5461aa604f190c2c96ef3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.081431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a1f5428be5461aa604f190c2c96ef3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.081731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.082114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.087491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a1f5428be5461aa604f190c2c96ef3'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.092068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1071/2143] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:29.092981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.107108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1073/2144] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:28 2022] DELETE /identity/v3/users/57a1f5428be5461aa604f190c2c96ef3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:29.108063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21e077-761c-4bc3-a015-57caaa75d678 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.112816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.114710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.171710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.172407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.172782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.173148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] PATH_INFO: `/v3/users/048ae7326970467887b939ebcafa1820` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.174498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048ae7326970467887b939ebcafa1820)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.177992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.183993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9cbc3-948a-4aee-8e87-8361e070ecdb admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.191530 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.193255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.193818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.193818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] PATH_INFO: `/v3/users/27529e1a19e0447f820d08bdc0885dc4` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.195163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27529e1a19e0447f820d08bdc0885dc4)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.197330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.237497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048ae7326970467887b939ebcafa1820'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.248700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048ae7326970467887b939ebcafa1820'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.249333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048ae7326970467887b939ebcafa1820'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.250109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048ae7326970467887b939ebcafa1820'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.254896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27529e1a19e0447f820d08bdc0885dc4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.262929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27529e1a19e0447f820d08bdc0885dc4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.263910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27529e1a19e0447f820d08bdc0885dc4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.264536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27529e1a19e0447f820d08bdc0885dc4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.264710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ee528418-5710-4c0f-88eb-2fd5307e4189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048ae7326970467887b939ebcafa1820'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.269453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:29.269579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:29.273075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bb9e7c55-2f5e-4b11-be28-024f2a80fb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27529e1a19e0447f820d08bdc0885dc4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:29.281513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1072/2145] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:29 2022] DELETE /identity/v3/users/048ae7326970467887b939ebcafa1820 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:29.282762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207189-2d84-4503-80d4-63a92a55ca20 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.283049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207189-2d84-4503-80d4-63a92a55ca20 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.283376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207189-2d84-4503-80d4-63a92a55ca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.297077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1074/2146] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:29 2022] DELETE /identity/v3/users/27529e1a19e0447f820d08bdc0885dc4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:29.299030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.299377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.299910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.305073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0c207189-2d84-4503-80d4-63a92a55ca20 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:29.306300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0c207189-2d84-4503-80d4-63a92a55ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.320694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:29.321918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.386154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1073/2147] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:29.397375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.397707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.397935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.401862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1075/2148] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:29.402751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.410563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.428788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:29.430440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.441852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1074/2149] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:29.443049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.444712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:29.503434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8a70-b26f-4aad-b844-718f79762a7f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.507933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.508563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.508847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.509121 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.536656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.538281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.551235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1076/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:29.552189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:29.563062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c4f8-a07e-4276-ab6b-0621b5c1f855 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.564761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890c3d8-3864-46a8-8526-6b2d0b9f99af None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:29.567327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.567959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.568239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.568513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.573115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:29.574032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:29.574458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:29.574869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:29.580422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.581983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.590448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:29.592519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:29.605992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1077/2151] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:29.609712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1075/2152] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:30.198764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.202082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.208044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.210722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.219730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db20e3d-eac1-4332-b358-8abd37ea0be9 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.225761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.226458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.226825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.227145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] PATH_INFO: `/v3/projects/7d13ee19e62a419c95dc553c53c28625` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.228014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67403a4a-1dfa-4d70-91df-8a8304bee848 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.228844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d13ee19e62a419c95dc553c53c28625)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.232251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.234146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.234806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.235126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.235420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] PATH_INFO: `/v3/projects/ca4b2049b56b4ba4abd272ec301d2f65` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.237307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4b2049b56b4ba4abd272ec301d2f65)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.242321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.298424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d13ee19e62a419c95dc553c53c28625', 'request_id': 'req-88a4fec2-10f3-45f7-9d1f-14336775e853'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.310971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d13ee19e62a419c95dc553c53c28625', 'request_id': 'req-88a4fec2-10f3-45f7-9d1f-14336775e853'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.313610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4b2049b56b4ba4abd272ec301d2f65', 'request_id': 'req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.317388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:30.320306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d13ee19e62a419c95dc553c53c28625', 'request_id': 'req-88a4fec2-10f3-45f7-9d1f-14336775e853'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.326134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4b2049b56b4ba4abd272ec301d2f65', 'request_id': 'req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.334553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4b2049b56b4ba4abd272ec301d2f65', 'request_id': 'req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.336091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] The token cache is being invalidate because project 7d13ee19e62a419c95dc553c53c28625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:30.336423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.337795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.339720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1078/2153] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:30 2022] DELETE /identity/v3/projects/7d13ee19e62a419c95dc553c53c28625 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:30.344029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.345555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.348906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] The token cache is being invalidate because project ca4b2049b56b4ba4abd272ec301d2f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:30.349198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.349879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c02f88c2-666c-4bf3-9e73-59e0f0a94a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.351445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1076/2154] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:30 2022] DELETE /identity/v3/projects/ca4b2049b56b4ba4abd272ec301d2f65 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:30.354729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.354729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.354729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.382249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:30.383204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.392965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:30.426283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fec2-10f3-45f7-9d1f-14336775e853 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.463007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1077/2155] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:30.464248 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.465496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.479283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96593c29-e67c-45d0-b115-3ce75a059b76 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.496996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.497643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.497915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.498183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] PATH_INFO: `/v3/users/1ad9a3f430164cc28acc44dc5aa70780` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.499583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad9a3f430164cc28acc44dc5aa70780)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.502593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.514763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.515410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.515740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.516016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] PATH_INFO: `/v3/projects/e28af5c0e75a4d7d80d5fa7bf57b2cca` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.523073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28af5c0e75a4d7d80d5fa7bf57b2cca)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.525123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.563898 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad9a3f430164cc28acc44dc5aa70780'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.577474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad9a3f430164cc28acc44dc5aa70780'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.578980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad9a3f430164cc28acc44dc5aa70780'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.580249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad9a3f430164cc28acc44dc5aa70780'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.587904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28af5c0e75a4d7d80d5fa7bf57b2cca', 'request_id': 'req-75dee9e4-ca46-47fe-9a7c-376dc3c99877'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.598826 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28af5c0e75a4d7d80d5fa7bf57b2cca', 'request_id': 'req-75dee9e4-ca46-47fe-9a7c-376dc3c99877'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.606767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-871938f9-29e7-4b88-8cda-74d1c5b38051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad9a3f430164cc28acc44dc5aa70780'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.607031 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28af5c0e75a4d7d80d5fa7bf57b2cca', 'request_id': 'req-75dee9e4-ca46-47fe-9a7c-376dc3c99877'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.619042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] The token cache is being invalidate because project e28af5c0e75a4d7d80d5fa7bf57b2cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:30.619339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.620161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-75dee9e4-ca46-47fe-9a7c-376dc3c99877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:30.621376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1078/2156] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:30 2022] DELETE /identity/v3/users/1ad9a3f430164cc28acc44dc5aa70780 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:30.622173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1079/2157] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:30 2022] DELETE /identity/v3/projects/e28af5c0e75a4d7d80d5fa7bf57b2cca => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:30.624404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.624799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.625560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.629668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.630262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.630679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.655646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:30.656880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.660868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:30.665019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.704865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:30.753153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1079/2158] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:30.757790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.776596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151239a4-adf4-48dd-b91c-ad922a1d1730 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.782070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.782334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.782575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.782847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.783522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:30.783829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.785408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef72318-d16d-4e97-ab85-ed1beb765b13 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.805247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1080/2159] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:30.805465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1080/2160] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:30.805567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.806987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.807920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.808293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.835100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27188fce-de61-457d-ba42-3ebe360ea2e3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.837568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:30.838868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:30.846687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.847387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.847692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.847962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.848730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.850859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.852219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1081/2161] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:30.857440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.871819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a4c5e-1580-403f-b6b2-27c0fae43bed None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:30.885211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:30.886463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:30.887542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:30.888026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:30.888975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:30.889342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:30.892436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:30.894684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:30.905135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1081/2162] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:30.911610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.924802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1082/2163] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:07:30.925744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:30.937117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a341d-11d4-445a-b7a8-3744ee43e6c0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.000069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec42d-46db-4417-a5e3-65b4b44db4c9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.006837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.007310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.007583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.007895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.008579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.011249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.036406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.037231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.037463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.037704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.039096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.041528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.045959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1082/2164] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:31.049721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.062581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039afd-4c40-4105-ad91-1c93d27b831b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.069099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.069922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.070175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.070633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.071391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.073594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1083/2165] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:30 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:31.073780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.077894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.095961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1083/2166] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:07:31.097991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.105336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.121226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f6703-70ad-4ef7-8402-2c26568cc127 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.150971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df5ccd-0bee-4894-a5c2-b5249cacc8bf admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.157901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.158539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.158819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.159092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.159857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.161833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.188899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1084/2167] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:31.189099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.189099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.189283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.189384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.189384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] PATH_INFO: `/v3/projects/70ace1f930364998bafb75f6231471de` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.189384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ace1f930364998bafb75f6231471de)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.192629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.197639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ccb7-7e0e-492a-8053-f1cd3dc06da3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.205705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.206603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.206880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.207151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.208835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.211392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.234077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:31.239174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1085/2168] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:31.240548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.251901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44d3e-c080-48b4-ae76-03f296c42ffd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.254694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ace1f930364998bafb75f6231471de', 'request_id': 'req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:31.263877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ace1f930364998bafb75f6231471de', 'request_id': 'req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:31.269907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ace1f930364998bafb75f6231471de', 'request_id': 'req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:31.281777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] The token cache is being invalidate because project 70ace1f930364998bafb75f6231471de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:31.282065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:31.282745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:31.284274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1084/2169] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:31 2022] DELETE /identity/v3/projects/70ace1f930364998bafb75f6231471de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:31.285009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.286312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.314294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:31.322643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e17192-7241-467a-9597-178532783f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.323893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17192-7241-467a-9597-178532783f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.324177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17192-7241-467a-9597-178532783f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.324473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e17192-7241-467a-9597-178532783f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.325284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e17192-7241-467a-9597-178532783f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.326914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e17192-7241-467a-9597-178532783f1a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.337566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1086/2170] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:31.338826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.339111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.339384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.359561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c455d34-a6bc-4e35-94c3-5119a31fb3f9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.359836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:31.361166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.365103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.366102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.366394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.366671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] PATH_INFO: `/v3/projects/0749bc410e344d6288d8a0ec9b5ef82e/users/bc2ab32845fc4d1bb24001127dc7b034/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.370317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1087/2171] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:31.371521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.372852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.385097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59976223-1dbe-4256-a5eb-7d6862d538c2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.390650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.391269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.391575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.391849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.391955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0749bc410e344d6288d8a0ec9b5ef82e, user_id=bc2ab32845fc4d1bb24001127dc7b034, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.392494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.394059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbb00f-1fac-41dd-9979-c3a5f6d75099 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.394542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.406510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1088/2172] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:31.410160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1085/2173] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:31 2022] PUT /identity/v3/projects/0749bc410e344d6288d8a0ec9b5ef82e/users/bc2ab32845fc4d1bb24001127dc7b034/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:31.410544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeff784-125a-4280-b815-a07366f93635 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.410828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeff784-125a-4280-b815-a07366f93635 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.411018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.411152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeff784-125a-4280-b815-a07366f93635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.435809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ddeff784-125a-4280-b815-a07366f93635 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:31.437071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ddeff784-125a-4280-b815-a07366f93635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.485302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993be4-12ff-487d-85cc-0c70c03c5ed5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.490414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.491258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.491726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.492192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] PATH_INFO: `/v3/projects/f4cfdff8214046e5a897373f520b8dc1/users/45b6c18b31324487842316f042e0b30b/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.503366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1089/2174] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:31.504736 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481dde-6654-4579-86ba-3aa626de67d5 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.505046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481dde-6654-4579-86ba-3aa626de67d5 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.505300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481dde-6654-4579-86ba-3aa626de67d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.510862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cfdff8214046e5a897373f520b8dc1, user_id=45b6c18b31324487842316f042e0b30b, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.514814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.532952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1086/2175] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:31 2022] PUT /identity/v3/projects/f4cfdff8214046e5a897373f520b8dc1/users/45b6c18b31324487842316f042e0b30b/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:31.540891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.546874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b8481dde-6654-4579-86ba-3aa626de67d5 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:31.548656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b8481dde-6654-4579-86ba-3aa626de67d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.567695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:31.639744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1090/2176] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:31.639744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.639744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.639744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.640100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd045c3-9eff-4c92-a177-55d4efb86179 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.640984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.641677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.641965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.642248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.642906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:31.643210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.644859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.659518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1087/2177] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:31.659518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.662365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.666341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] MFA Rules not processed for user `45b6c18b31324487842316f042e0b30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:31.666341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.738234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a047b-6e84-48b2-b39a-c1f36207b844 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.742431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.743195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.743308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.743594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.754921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.755236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1091/2178] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:31.756202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.757252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.769173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1088/2179] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:31.770073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.771451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:31.784630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611fb2c9-9e16-41e3-b0f1-35460bb4605a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.791375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.793101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.793694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.794750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.795837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:31.798372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:31.805567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:31.842671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a38c61-5608-415e-bc72-b7031b5f3b9e service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.844743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1092/2180] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:31.849264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:31.977412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.978026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.978316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.978587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:31.983313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1088e70-a4b4-4f85-8455-656d21c5861c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:31.996450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:31.997849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:31.998495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:31.998956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.004518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.012466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.034182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:32.077525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1093/2181] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:31 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:32.078573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.089561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7211-e175-4a04-a246-2e24fe45db1b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.096712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.097335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.097615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.098042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.098800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.100934 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.120583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1094/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:32.122071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.123647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.124271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.137801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7bf5b-1c4e-490b-acba-fb3a9ced7086 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.145180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.147037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.148741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.149098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.153917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.155548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8568-cba4-495c-8918-a0d2f7675cb9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.167175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1089/2183] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:32.171648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1095/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:32.172208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.193730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f1be-ed0c-4a3b-877d-8f67706fa74d service glance] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.208207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.208207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.208207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.208207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] PATH_INFO: `/v3/projects/35f43b8a75ef42878496200e4d5f3656/users/d61bc23ece8f4578b2f2f0619d2e7870/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.223539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f43b8a75ef42878496200e4d5f3656, user_id=d61bc23ece8f4578b2f2f0619d2e7870, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.226874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.249591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1090/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:32 2022] PUT /identity/v3/projects/35f43b8a75ef42878496200e4d5f3656/users/d61bc23ece8f4578b2f2f0619d2e7870/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:32.261167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.262093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.262375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.309345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] MFA Rules not processed for user `d61bc23ece8f4578b2f2f0619d2e7870`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:32.312160 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:32.395423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1096/2186] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:32.400514 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.548557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6646c6d-8bf7-4d5b-a55c-2031707a8121 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.568707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.569373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.569632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.569914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.570789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.572823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.608527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1091/2187] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:32 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:32.613491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.626462 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe57e-7488-4b32-91d7-88029c3ae99a None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.689363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:32.725003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.726184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.726467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.726742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.727609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.739174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.781947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1097/2188] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:32 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:32.785720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.797582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1a4c-55da-4ada-af8e-b30f21125ef1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.824895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.825949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.826625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.826860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.827747 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.829690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd78f7-6df0-4196-8bf5-31d4b7882ef2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.855431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1092/2189] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:32.857830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.870102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836acca-f92c-4710-9692-7f4494ff0bd2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.880137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.880538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.880848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.880957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.881093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.881631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.881748 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.882498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.884230 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.897641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1098/2190] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:32.902732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:32.916126 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] MFA Rules not processed for user `bc2ab32845fc4d1bb24001127dc7b034`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:32.918321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:32.918764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8931-71fc-4de5-a521-d574a3ff16fa admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:32.924238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:32.924918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.925192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.925464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] PATH_INFO: `/v3/projects/79625736775848b0b0788de92e0f9a84/users/8693f8970f92411e9a5170ee46d94d75/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:32.944393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79625736775848b0b0788de92e0f9a84, user_id=8693f8970f92411e9a5170ee46d94d75, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:32.947043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f71f2-796e-4f5f-9a37-fa5dcf0275f6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:32.968031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1099/2191] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:32 2022] PUT /identity/v3/projects/79625736775848b0b0788de92e0f9a84/users/8693f8970f92411e9a5170ee46d94d75/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:32.980700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:32.980992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:32.981535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.012167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1093/2192] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:33.025030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.029867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:33.030169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] MFA Rules not processed for user `8693f8970f92411e9a5170ee46d94d75`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:33.031758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:33.048359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:33.112277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9104c32-4c82-4ef9-ad3c-28b232ab9af6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.115494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1100/2193] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:33.119696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.162458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.163084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.163330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.163642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.185539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bae11-03d6-495e-b0ba-9f122dc8f156 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.190323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.191047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.191329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.191631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.192253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.194139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.221820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1101/2194] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:33 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:07:33.223996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.225477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.226192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.236185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1094/2195] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:33.242445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:33.311951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb378e9-b2bb-4577-9541-89e37152dbcd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.318463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.319237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.319785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.320031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.321363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.323481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.358226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1102/2196] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:33 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:33.359220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.371227 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d9370-d230-45b5-8816-73b28284ec4c service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.376776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.377658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.377658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.377946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.378583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.380761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.393759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1095/2197] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:33.397814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.408926 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59bf0d-dd5e-4a79-9644-f69039ffc7d0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.414734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.430944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.431339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.431775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] PATH_INFO: `/v3/projects/a1b6913996e042ce864fc1b34edc6062/users/212c6f85ff4748af899e961da6e64303/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.455329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b6913996e042ce864fc1b34edc6062, user_id=212c6f85ff4748af899e961da6e64303, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.456757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.476606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1103/2198] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:33 2022] PUT /identity/v3/projects/a1b6913996e042ce864fc1b34edc6062/users/212c6f85ff4748af899e961da6e64303/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:33.481748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.494373 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f18b5-e43b-4f97-8203-0c77a7ac77f8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.595157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.595818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.596094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.596362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.597353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.598614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86757c-f3fb-4731-9ff1-2f595b7f7f9b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.612467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1096/2199] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:33.616746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.628079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5942fe-6451-4ef6-8ef7-415a8db2395a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.633358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.634028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.634355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.634632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] PATH_INFO: `/v3/projects/a1b6913996e042ce864fc1b34edc6062/users/212c6f85ff4748af899e961da6e64303/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.636851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b6913996e042ce864fc1b34edc6062, user_id=212c6f85ff4748af899e961da6e64303, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.639641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.669515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711cf76-6daa-459c-a9e8-e2df6cf9e879 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.669829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711cf76-6daa-459c-a9e8-e2df6cf9e879 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.670069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711cf76-6daa-459c-a9e8-e2df6cf9e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.674509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1104/2200] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:33 2022] PUT /identity/v3/projects/a1b6913996e042ce864fc1b34edc6062/users/212c6f85ff4748af899e961da6e64303/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:33.680303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:33.710376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a711cf76-6daa-459c-a9e8-e2df6cf9e879 None None] MFA Rules not processed for user `212c6f85ff4748af899e961da6e64303`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:33.711922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a711cf76-6daa-459c-a9e8-e2df6cf9e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:33.802752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1097/2201] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:33.814308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:33.816038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:33.878687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d869e76-520c-49ab-be48-4b8538f3a842 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:33.883852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:33.884568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:33.884848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:33.885115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:33.943017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:33.944544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:33.953762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1105/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:34.745995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:34.746499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:34.746758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:34.768087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] MFA Rules not processed for user `bc2ab32845fc4d1bb24001127dc7b034`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:34.769305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:34.866981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1098/2203] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:35.515427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:35.524510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe471a9-3f40-4039-9e80-6c42bc73c8d0 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:35.529857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:35.531016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:35.531369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:35.531744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:35.549134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:35.595892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:35.597239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:35.608575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1106/2204] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:36.285006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:36.295823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcefe7-35ed-49c3-9f09-ed2502fdb1aa None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:36.299432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:36.300079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:36.300365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:36.300692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:36.314630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:36.316463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd01956-e87f-477c-ab63-14676a124b49 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:36.329513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1099/2205] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:40.317588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:40.382538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08ca8-a35b-450e-bd06-eb02a2151ae8 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:40.387788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:40.388415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:40.388695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:40.388969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] PATH_INFO: `/v3/users/d61bc23ece8f4578b2f2f0619d2e7870` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:40.390086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61bc23ece8f4578b2f2f0619d2e7870)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:40.392030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:40.439592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61bc23ece8f4578b2f2f0619d2e7870'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:40.447843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61bc23ece8f4578b2f2f0619d2e7870'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:40.448525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61bc23ece8f4578b2f2f0619d2e7870'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:40.449737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61bc23ece8f4578b2f2f0619d2e7870'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:40.464692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61bc23ece8f4578b2f2f0619d2e7870'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:40.476879 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1107/2206] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:40 2022] DELETE /identity/v3/users/d61bc23ece8f4578b2f2f0619d2e7870 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:40.482201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1a74-76bc-4609-a937-c729008761ae None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:40.482702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1a74-76bc-4609-a937-c729008761ae None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:40.482822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1a74-76bc-4609-a937-c729008761ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:40.502097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-904a1a74-76bc-4609-a937-c729008761ae None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:40.503338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-904a1a74-76bc-4609-a937-c729008761ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:40.566435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1100/2207] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:40.577623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:40.579503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:40.621762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:40.641278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b75d9d-9dad-42fc-ae95-031a33348b48 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:40.645026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:40.645633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:40.645911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:40.646183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:40.657131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:40.658586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:40.669338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1108/2208] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:40.960312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a1a74-76bc-4609-a937-c729008761ae None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:40.961973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-904a1a74-76bc-4609-a937-c729008761ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:40.975938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a1a74-76bc-4609-a937-c729008761ae None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:40.980295 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:40.980953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:40.981234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:40.981507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] PATH_INFO: `/v3/projects/35f43b8a75ef42878496200e4d5f3656` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:40.982679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f43b8a75ef42878496200e4d5f3656)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:40.984670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:41.002339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:41.036480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f43b8a75ef42878496200e4d5f3656', 'request_id': 'req-07bee857-4c88-4eab-a1bf-7d758b701752'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.044899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f43b8a75ef42878496200e4d5f3656', 'request_id': 'req-07bee857-4c88-4eab-a1bf-7d758b701752'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.051301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f43b8a75ef42878496200e4d5f3656', 'request_id': 'req-07bee857-4c88-4eab-a1bf-7d758b701752'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.063528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] The token cache is being invalidate because project 35f43b8a75ef42878496200e4d5f3656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:41.063843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.064485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.065975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1101/2209] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:40 2022] DELETE /identity/v3/projects/35f43b8a75ef42878496200e4d5f3656 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:41.070334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:41.082210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984de7ec-d002-40e4-af25-4177faa0924b service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:41.140070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:41.140716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:41.140974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:41.141261 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] PATH_INFO: `/v3/users/8693f8970f92411e9a5170ee46d94d75` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:41.142426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8693f8970f92411e9a5170ee46d94d75)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:41.144369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:41.199809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8693f8970f92411e9a5170ee46d94d75'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.207099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8693f8970f92411e9a5170ee46d94d75'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.207728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8693f8970f92411e9a5170ee46d94d75'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.208338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8693f8970f92411e9a5170ee46d94d75'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.220803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8693f8970f92411e9a5170ee46d94d75'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.241739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1109/2210] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:41 2022] DELETE /identity/v3/users/8693f8970f92411e9a5170ee46d94d75 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:41.536376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:41.537982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:41.551362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee857-4c88-4eab-a1bf-7d758b701752 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:41.619531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:41.620176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:41.620447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:41.620721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] PATH_INFO: `/v3/projects/79625736775848b0b0788de92e0f9a84` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:41.621915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79625736775848b0b0788de92e0f9a84)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:41.623861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:41.674179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79625736775848b0b0788de92e0f9a84', 'request_id': 'req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.681888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79625736775848b0b0788de92e0f9a84', 'request_id': 'req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.689360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79625736775848b0b0788de92e0f9a84', 'request_id': 'req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.701006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] The token cache is being invalidate because project 79625736775848b0b0788de92e0f9a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:41.701290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.701913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.703387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1102/2211] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:41 2022] DELETE /identity/v3/projects/79625736775848b0b0788de92e0f9a84 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:41.707394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:41.708856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:41.723206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8a14-bc9b-485b-9977-5419ae5b78e7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:41.777125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:41.785257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:41.786099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:41.786707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:41.787247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] PATH_INFO: `/v3/users/212c6f85ff4748af899e961da6e64303` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:41.788554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=212c6f85ff4748af899e961da6e64303)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:41.790549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:41.842941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212c6f85ff4748af899e961da6e64303'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.851032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212c6f85ff4748af899e961da6e64303'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.851682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212c6f85ff4748af899e961da6e64303'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.852290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212c6f85ff4748af899e961da6e64303'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.866922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b7e546ca-68de-40dc-b213-01936c01ad03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212c6f85ff4748af899e961da6e64303'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:41.879355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1110/2212] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:41 2022] DELETE /identity/v3/users/212c6f85ff4748af899e961da6e64303 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:42.199122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.201023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:42.216415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbe6ae-e7c4-400d-a76e-bd10cc70cfe0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.257739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:42.285585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.286813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.287090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.287357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] PATH_INFO: `/v3/projects/a1b6913996e042ce864fc1b34edc6062` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.288495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b6913996e042ce864fc1b34edc6062)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.290416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.343472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b6913996e042ce864fc1b34edc6062', 'request_id': 'req-a053921d-1bb7-4aaa-a392-4f4e91979a59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:42.351960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b6913996e042ce864fc1b34edc6062', 'request_id': 'req-a053921d-1bb7-4aaa-a392-4f4e91979a59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:42.358332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b6913996e042ce864fc1b34edc6062', 'request_id': 'req-a053921d-1bb7-4aaa-a392-4f4e91979a59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:42.369636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] The token cache is being invalidate because project a1b6913996e042ce864fc1b34edc6062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:42.370446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:42.371075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-a053921d-1bb7-4aaa-a392-4f4e91979a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:42.372576 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1103/2213] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:42 2022] DELETE /identity/v3/projects/a1b6913996e042ce864fc1b34edc6062 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:07:42.377448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.377743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.378047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.398764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:42.400036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:42.463136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1111/2214] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:42.471552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.471844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.472120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.494316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:42.495829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:42.503776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1104/2215] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:42.508026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.518146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f203c-a367-4e95-9ac2-7941649ee7a6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.522972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.524076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.524076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.524303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.525063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:42.525394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.530701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.542662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1112/2216] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:42.547619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.558810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b7366-c7b0-4282-b1c6-32b70aafc1a7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.563678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.564282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.564554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.564818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.565442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.567362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.601410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1105/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:42 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:42.606396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.616290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf88273-c50e-48e4-9e08-69907cee8097 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.675186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.675825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.676101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.676370 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.676999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.680070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.693654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:42.709756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1113/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:42 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:42.714289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.724360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfd41-7012-4610-838e-e06d58820ad1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.729748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.730481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.730760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.731020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.731679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.733272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.743364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1106/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:42.747914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.759123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ebaaf-bca0-4f3f-90a6-08ff29d8e551 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.764772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.765680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.766223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.766505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.767204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.771594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4694ea-969d-4cf3-a3cf-03b8b0ff7dce admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.783885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1114/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:42.788086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:42.800235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801a4db-6c8e-4102-846d-16038d9ff817 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:42.808512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:42.809160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.809434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.809704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] PATH_INFO: `/v3/projects/920b85fb8f634b51877dc3a80ef06ffd/users/cbb5166254ce463e9db4ab9ac24c6686/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.824843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920b85fb8f634b51877dc3a80ef06ffd, user_id=cbb5166254ce463e9db4ab9ac24c6686, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:42.827481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:42.841668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1107/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:42 2022] PUT /identity/v3/projects/920b85fb8f634b51877dc3a80ef06ffd/users/cbb5166254ce463e9db4ab9ac24c6686/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:42.911336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc698f-9288-4fa8-a475-650414b804f6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:42.911696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc698f-9288-4fa8-a475-650414b804f6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:42.912003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc698f-9288-4fa8-a475-650414b804f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:42.942897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7bcc698f-9288-4fa8-a475-650414b804f6 None None] MFA Rules not processed for user `cbb5166254ce463e9db4ab9ac24c6686`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:42.944148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7bcc698f-9288-4fa8-a475-650414b804f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:43.010855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1115/2222] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:43.021536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:43.023435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:43.083087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab329cd-bf7a-4ef0-b78a-eb82ebcfd572 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:43.086823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:43.087439 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:43.087789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:43.088323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:43.101001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:43.102664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:43.114243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1108/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:07:44.514368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a023b-4e65-4503-a0cc-a4d4e632fe97 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:44.514847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a023b-4e65-4503-a0cc-a4d4e632fe97 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:44.514939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a023b-4e65-4503-a0cc-a4d4e632fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:44.535234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bc0a023b-4e65-4503-a0cc-a4d4e632fe97 None None] MFA Rules not processed for user `cbb5166254ce463e9db4ab9ac24c6686`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:44.536508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bc0a023b-4e65-4503-a0cc-a4d4e632fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:44.543327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1116/2224] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:53.109366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:54.529552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:INSERT=1,keystone:SELECT=42 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:55.093989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:55.095430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:55.177669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f6d6-789a-41ee-91b5-82b697065342 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:55.188772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:55.189744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:55.190141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:55.190509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] PATH_INFO: `/v3/users/dec97810c23044f7b6c54ecb6028c521` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:55.193163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec97810c23044f7b6c54ecb6028c521)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:55.196395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:55.295034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec97810c23044f7b6c54ecb6028c521'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.303538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec97810c23044f7b6c54ecb6028c521'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.304499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec97810c23044f7b6c54ecb6028c521'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.305280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec97810c23044f7b6c54ecb6028c521'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.317302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec97810c23044f7b6c54ecb6028c521'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.364559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:55.365146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:55.365917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:55.369407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1109/2225] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:07:55 2022] DELETE /identity/v3/users/dec97810c23044f7b6c54ecb6028c521 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:55.390644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:55.392036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:55.463446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1117/2226] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:55.473996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:55.476147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:55.539863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcab1-e450-4844-aa90-9394d1b7cad1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:55.543554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:55.544133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:55.544967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:55.545239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:55.554547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:55.556014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fe00d-4acb-471f-8737-9e0a2797363d service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:55.566194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1110/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:07:55.844413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:55.846043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:55.868337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0e5d7-fc7b-4d9c-aa9f-7563c854b797 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:55.874187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:55.874830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:55.875113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:55.875390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] PATH_INFO: `/v3/projects/16de85ca61f848c980e0dd02f32bc09a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:55.876593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16de85ca61f848c980e0dd02f32bc09a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:55.878532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:55.958779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16de85ca61f848c980e0dd02f32bc09a', 'request_id': 'req-afa518d2-45c2-4b02-bca7-f940f22d7e4f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.974019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16de85ca61f848c980e0dd02f32bc09a', 'request_id': 'req-afa518d2-45c2-4b02-bca7-f940f22d7e4f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.982291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16de85ca61f848c980e0dd02f32bc09a', 'request_id': 'req-afa518d2-45c2-4b02-bca7-f940f22d7e4f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:55.999646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] The token cache is being invalidate because project 16de85ca61f848c980e0dd02f32bc09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:07:56.000116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:56.001007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-afa518d2-45c2-4b02-bca7-f940f22d7e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:07:56.006275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1118/2228] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:07:55 2022] DELETE /identity/v3/projects/16de85ca61f848c980e0dd02f32bc09a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:56.007918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.008471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.008750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.036559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:56.037811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:56.062918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:56.147858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1111/2229] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:56.156631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.157011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.157190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.182159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:56.183871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:56.195448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1119/2230] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:07:56.199824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.211991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b71002-5340-4971-aa04-3b3e256ed5a7 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.216857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.217483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.217764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.218114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.218775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:07:56.219191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.222332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.234219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1112/2231] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:07:56.238694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.254177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845dd7c-ca16-47c1-a089-5b411f3b71fc None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.260363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.261243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.261707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.262176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.263620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.266243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.320068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1120/2232] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:07:56 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:56.324551 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.336891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeebfe9-6015-4028-9a4f-004a660b0a3f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.478061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.479519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.480046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.480425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.481299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.486602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.539671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1113/2233] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:07:56 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:07:56.541031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.556976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667116a-41f8-463e-8fa3-aafb22618906 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.571513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.577427 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.577731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.577978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.578659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.581138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.598175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1121/2234] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:56.600144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.613746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff178-20df-40e1-bcd7-8741c85556ff admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.618677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.620026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.620315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.620582 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.621632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.625185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a7ca-2974-4f1a-93b5-422e7b830439 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.643151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1114/2235] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:07:56.644410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.668405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf5dd-0d1f-44d6-a682-d0214885d9e5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.693398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.694175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.695515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.697732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] PATH_INFO: `/v3/projects/70d4a73b6a6f46808799d0de7261c80c/users/7ce0eb5b229b4b7790850a02044f6884/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.722257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d4a73b6a6f46808799d0de7261c80c, user_id=7ce0eb5b229b4b7790850a02044f6884, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.725171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.741806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1122/2236] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:07:56 2022] PUT /identity/v3/projects/70d4a73b6a6f46808799d0de7261c80c/users/7ce0eb5b229b4b7790850a02044f6884/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:07:56.748431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397591-8eb7-449c-8630-19b1bf1f0a13 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.748860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397591-8eb7-449c-8630-19b1bf1f0a13 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.749266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397591-8eb7-449c-8630-19b1bf1f0a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.778257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9a397591-8eb7-449c-8630-19b1bf1f0a13 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:07:56.780992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9a397591-8eb7-449c-8630-19b1bf1f0a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:56.856012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1115/2237] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:07:56.865623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:07:56.867409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:07:56.891428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:07:56.934650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d26d46-793c-4412-8c59-885a86949c48 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:07:56.940255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:07:56.940902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:07:56.941179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:07:56.941447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:07:56.960334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:07:56.961823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:07:56.973085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1123/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:03.697906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:03.698517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:03.698517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:03.733853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] MFA Rules not processed for user `7ce0eb5b229b4b7790850a02044f6884`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:03.735196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:03.756209 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:03.832860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1116/2239] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:03.838320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:03.850244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5644f-07ba-4391-b28c-07117d6c7634 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:03.855172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:03.855811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:03.856084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:03.856347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:03.857300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:03.859353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:03.899071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1124/2240] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:08:03 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:08:03.899392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:03.936594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c30832-cbc2-4fb2-acf1-68ac9fe6f48d None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.044138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.044980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.045354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.045783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.046630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.053712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.080949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1117/2241] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:08:03 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:08:04.085288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:04.100975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862732e-d8fd-4be7-a8dc-ff49b63615b3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.106196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.106917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.107192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.107479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.113084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.113084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.126914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1125/2242] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:04.146162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:04.165898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee585d-68f9-4bf3-84f0-5c5d29c3807b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.171533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.172311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.172599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.172929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] PATH_INFO: `/v3/projects/941590379f5a41f3aa5f2bb255749e4d/users/c2e5fc5b12404f098baac30e2bfc84ee/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.199490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941590379f5a41f3aa5f2bb255749e4d, user_id=c2e5fc5b12404f098baac30e2bfc84ee, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.203871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.225760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1118/2243] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:04 2022] PUT /identity/v3/projects/941590379f5a41f3aa5f2bb255749e4d/users/c2e5fc5b12404f098baac30e2bfc84ee/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:04.230120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:04.245223 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b4dd1-1991-4137-873d-ef58c76ce6ac admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.340703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.342225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.342560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.342844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.343522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.345157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.356027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1126/2244] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:08:04.361228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:04.372855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4c7d-338f-48b7-9ff9-94e55f08b488 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:04.377832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:04.378498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:04.378778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:04.379049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] PATH_INFO: `/v3/projects/941590379f5a41f3aa5f2bb255749e4d/users/c2e5fc5b12404f098baac30e2bfc84ee/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:04.381351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=941590379f5a41f3aa5f2bb255749e4d, user_id=c2e5fc5b12404f098baac30e2bfc84ee, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:04.384379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554798e-9eb1-4425-b8b8-589e31b7b7ce admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:04.395584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1119/2245] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:08:04 2022] PUT /identity/v3/projects/941590379f5a41f3aa5f2bb255749e4d/users/c2e5fc5b12404f098baac30e2bfc84ee/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:08:07.800586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:07.805986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:07.830037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43228294-cfd6-4c43-947e-103aecf21ce1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.032271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.032936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.033217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.033491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] PATH_INFO: `/v3/users/45b6c18b31324487842316f042e0b30b` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.034788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b6c18b31324487842316f042e0b30b)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.036753 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.111348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:08.154153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b6c18b31324487842316f042e0b30b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:08.172426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b6c18b31324487842316f042e0b30b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:08.173126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b6c18b31324487842316f042e0b30b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:08.173761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b6c18b31324487842316f042e0b30b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:08.201675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b6c18b31324487842316f042e0b30b'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:08.248662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1127/2246] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:07 2022] DELETE /identity/v3/users/45b6c18b31324487842316f042e0b30b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:08.252938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.253448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.253553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.308205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:08.309515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:08.422517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1120/2247] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:08.464761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:08.471556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:08.638912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad47e8-fc54-4ba4-a7ee-3e991847f548 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:08.647080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:08.647756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:08.648034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:08.648310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:08.676184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:08.678213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41f20-5af8-4063-bdda-a6416401c19b service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:08.710569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1128/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:09.615892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:09.617358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:09.640420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab1890-6ac4-4e4a-a08e-34d5354f89eb None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:09.646818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:09.647681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:09.648153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:09.648942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] PATH_INFO: `/v3/projects/f4cfdff8214046e5a897373f520b8dc1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:09.650364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cfdff8214046e5a897373f520b8dc1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:09.653003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:09.663110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:09.738945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cfdff8214046e5a897373f520b8dc1', 'request_id': 'req-c5f6ac90-949e-4566-b0ad-cdb47148d86e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:09.749811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cfdff8214046e5a897373f520b8dc1', 'request_id': 'req-c5f6ac90-949e-4566-b0ad-cdb47148d86e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:09.759154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cfdff8214046e5a897373f520b8dc1', 'request_id': 'req-c5f6ac90-949e-4566-b0ad-cdb47148d86e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:09.775596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] The token cache is being invalidate because project f4cfdff8214046e5a897373f520b8dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:09.776046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:09.777066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:09.779932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1121/2249] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:09 2022] DELETE /identity/v3/projects/f4cfdff8214046e5a897373f520b8dc1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:11.055742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785563-7241-4e62-afa8-6e5f0138a978 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.056679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785563-7241-4e62-afa8-6e5f0138a978 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.057511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785563-7241-4e62-afa8-6e5f0138a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.103086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-a2785563-7241-4e62-afa8-6e5f0138a978 None None] MFA Rules not processed for user `c2e5fc5b12404f098baac30e2bfc84ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.104756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a2785563-7241-4e62-afa8-6e5f0138a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.207713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1129/2250] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:11.224097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:11.229073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.329415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6ac90-949e-4566-b0ad-cdb47148d86e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:11.333406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:11.334140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.334518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.334889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.336785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.415651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:11.417250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:11.429332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1122/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:11.612975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b28-2cf4-42e0-b2f3-aa9a09814f22 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.613357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b28-2cf4-42e0-b2f3-aa9a09814f22 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.613707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1b28-2cf4-42e0-b2f3-aa9a09814f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:11.637283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9f6d1b28-2cf4-42e0-b2f3-aa9a09814f22 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:11.638703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9f6d1b28-2cf4-42e0-b2f3-aa9a09814f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.718669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:11.765795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1130/2252] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:11.825083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:11.832498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:11.937615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:11.985935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e9bb4-b945-430c-93b9-e41a2fa002a3 service glance] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:11.998304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:11.998304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:11.998304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:11.998304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:12.010776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:12.014574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:12.031683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1123/2253] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:15.773318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4d0d-414f-410d-a762-aab592d26772 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:15.773778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4d0d-414f-410d-a762-aab592d26772 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:15.773878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd4d0d-414f-410d-a762-aab592d26772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:15.805947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cdbd4d0d-414f-410d-a762-aab592d26772 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:15.814101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cdbd4d0d-414f-410d-a762-aab592d26772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:15.846682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1131/2254] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:15.851874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:15.867489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1a3a-9843-4da1-9df4-a01bcacc14eb service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:15.881048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:15.881910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:15.882480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:15.883073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:15.908560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:15.910448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:15.924492 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1124/2255] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:17.154501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65a69-ba8b-4561-906c-78896f7875e7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.158815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65a69-ba8b-4561-906c-78896f7875e7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.159120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a65a69-ba8b-4561-906c-78896f7875e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.202946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-04a65a69-ba8b-4561-906c-78896f7875e7 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:17.205204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-04a65a69-ba8b-4561-906c-78896f7875e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:17.215906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1132/2256] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:17.266128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:17.284708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175b0b-e715-49c2-84dd-683302e7815e service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:17.291741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:17.292614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.298976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.299292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.325510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:17.335447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:17.362323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1125/2257] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:17.932102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9faf8d-7c13-422e-b24b-6cb78d568284 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:17.932569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9faf8d-7c13-422e-b24b-6cb78d568284 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:17.932867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9faf8d-7c13-422e-b24b-6cb78d568284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:17.971595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cc9faf8d-7c13-422e-b24b-6cb78d568284 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:17.975978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cc9faf8d-7c13-422e-b24b-6cb78d568284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:17.991998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1133/2258] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:08:18.019510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:18.044230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824de2-05cf-4df1-b765-c1deb0c299f2 service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:18.053112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:18.054266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:18.054693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:18.055115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:18.070971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:18.072665 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:18.088188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1126/2259] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:18.790731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86f108-b454-453e-9656-3fe6cac6de0b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:18.791227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86f108-b454-453e-9656-3fe6cac6de0b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:18.791633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86f108-b454-453e-9656-3fe6cac6de0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:18.828588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6f86f108-b454-453e-9656-3fe6cac6de0b None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:18.830260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6f86f108-b454-453e-9656-3fe6cac6de0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:18.852504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1134/2260] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:18.878334 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:18.899320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea39524-5180-40f5-94de-c842bca7a196 service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:18.914316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:18.915274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:18.915634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:18.915911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:18.940619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:18.942387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27473285-fed1-4c05-a663-1bda819479cc service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:18.953195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1127/2261] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:19.639341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:19.639687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:19.640220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:19.671773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] MFA Rules not processed for user `7a8a52a175954db1bab6545353bb878d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:19.672853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:19.793467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1135/2262] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:20.477872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:20.478434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:20.478434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:20.501889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:20.503627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:20.514877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1128/2263] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:20.530905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:20.550054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b72d1-1389-4e03-833f-a97b337970c4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:20.555852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:20.556750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:20.557200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:20.557717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:20.598097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:20.605269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7a5ba-11e8-4d26-98a6-e849acaa7237 service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:20.620247 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1136/2264] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:21.789681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:21.791184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:21.944125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2a21-d677-47ee-80c0-245dc55166a9 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:21.953696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:21.954752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:21.955105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:21.955584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] PATH_INFO: `/v3/users/cbb5166254ce463e9db4ab9ac24c6686` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:21.962275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb5166254ce463e9db4ab9ac24c6686)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:21.965506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:22.058754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb5166254ce463e9db4ab9ac24c6686'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:22.080202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb5166254ce463e9db4ab9ac24c6686'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:22.081934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb5166254ce463e9db4ab9ac24c6686'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:22.082560 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb5166254ce463e9db4ab9ac24c6686'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:22.093643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb5166254ce463e9db4ab9ac24c6686'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:22.110549 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:22.127716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1129/2265] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:08:21 2022] DELETE /identity/v3/users/cbb5166254ce463e9db4ab9ac24c6686 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:22.139290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:22.140236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:22.140895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:22.192882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:22.194112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:22.348663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1137/2266] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:22.350213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:22.352106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:22.478975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44f1b3-644e-4a62-9cc1-b80f0125649e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:22.496294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:22.499423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:22.499885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:22.500900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:22.538827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:22.544697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cbfbd-0e91-479e-bfe6-3de06d3de685 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:22.565656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1130/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:08:22.961323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:22.964259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:22.987232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56f245-0af7-4952-ac9f-4fdc4b9d1545 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:23.028628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:23.029638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:23.030134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:23.030563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] PATH_INFO: `/v3/projects/920b85fb8f634b51877dc3a80ef06ffd` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:23.032027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920b85fb8f634b51877dc3a80ef06ffd)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:23.034178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:23.206525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:23.288516 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920b85fb8f634b51877dc3a80ef06ffd', 'request_id': 'req-df0625bf-8d77-482c-9bd9-749fc029df83'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.388485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920b85fb8f634b51877dc3a80ef06ffd', 'request_id': 'req-df0625bf-8d77-482c-9bd9-749fc029df83'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.412583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920b85fb8f634b51877dc3a80ef06ffd', 'request_id': 'req-df0625bf-8d77-482c-9bd9-749fc029df83'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.472712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] The token cache is being invalidate because project 920b85fb8f634b51877dc3a80ef06ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:08:23.472997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.484802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-df0625bf-8d77-482c-9bd9-749fc029df83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:08:23.491548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1138/2268] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:08:22 2022] DELETE /identity/v3/projects/920b85fb8f634b51877dc3a80ef06ffd => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:08:26.943262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:26.943896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:26.943896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:26.954895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77fa2-cffa-49b1-aee3-2c5ad2814f77 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:26.955711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77fa2-cffa-49b1-aee3-2c5ad2814f77 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:26.955711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd77fa2-cffa-49b1-aee3-2c5ad2814f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:26.992957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] MFA Rules not processed for user `7ce0eb5b229b4b7790850a02044f6884`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:26.994192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.000568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ffd77fa2-cffa-49b1-aee3-2c5ad2814f77 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:27.002395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ffd77fa2-cffa-49b1-aee3-2c5ad2814f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.067758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1131/2269] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:27.083300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1139/2270] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:27.115570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:27.117449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:27.225016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92251f47-245d-481a-bc59-264b6fcc6818 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:27.239256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:27.240165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:27.240283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:27.240515 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:27.252966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:27.254596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:27.269527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1132/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:31.307854 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d2c-2ef8-4c7e-b719-c2e3a9455ed7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.308678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d2c-2ef8-4c7e-b719-c2e3a9455ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.309158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e56d2c-2ef8-4c7e-b719-c2e3a9455ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.343792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-80e56d2c-2ef8-4c7e-b719-c2e3a9455ed7 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:31.345081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-80e56d2c-2ef8-4c7e-b719-c2e3a9455ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.472182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1140/2272] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:08:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:31.495048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:31.498380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:31.549685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:31.595815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79508a75-59bd-41e1-ab2e-ae0562473956 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:31.602722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:31.604353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:31.604669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:31.604946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:31.615856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:31.617627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:31.634392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1133/2273] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:08:32.181012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9973e-202f-4c2d-97a7-329c173bda73 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.181443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9973e-202f-4c2d-97a7-329c173bda73 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.181818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9973e-202f-4c2d-97a7-329c173bda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.218424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7ae9973e-202f-4c2d-97a7-329c173bda73 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:32.219692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7ae9973e-202f-4c2d-97a7-329c173bda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:32.232310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1141/2274] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:32.269513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:32.271112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:32.288280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bdc0c-fd65-44f3-b657-37ea7f870a64 service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:32.298850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:32.299596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:32.299975 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:32.300495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:32.312271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:32.313973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:32.334962 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1134/2275] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:42.211021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=65,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:42.323178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=24 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:08:48.933286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d631b5-dd6d-43e8-b474-33760d77f0ee None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:48.933896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d631b5-dd6d-43e8-b474-33760d77f0ee None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:48.933896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d631b5-dd6d-43e8-b474-33760d77f0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:48.953761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-29d631b5-dd6d-43e8-b474-33760d77f0ee None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:48.954966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-29d631b5-dd6d-43e8-b474-33760d77f0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:48.962881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1142/2276] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:48.987759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:49.000280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43baf2-acd1-4c70-a95a-9eef2c6a1f87 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:49.008229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:49.008753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:49.009040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:49.009315 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:49.022992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:49.024679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751170b-fbd9-40fd-be29-8c777706c107 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:49.037814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1135/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:52.895146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:52.895609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:52.896190 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:52.916288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] MFA Rules not processed for user `1c9de09d725f48db8cc9ac13a2ca3a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:52.917692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:52.987606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1143/2278] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.105271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7b89-55c8-4ce1-b861-f2664a4e03b7 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.105780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7b89-55c8-4ce1-b861-f2664a4e03b7 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.105780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7b89-55c8-4ce1-b861-f2664a4e03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.129219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6cbe7b89-55c8-4ce1-b861-f2664a4e03b7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:54.131947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6cbe7b89-55c8-4ce1-b861-f2664a4e03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.142614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1136/2279] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.230884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.250056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76c06-0a8b-49c2-9bd6-ff8bc2ca0369 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:54.261246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:54.262637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.263037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.263558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.272712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:54.274482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473b2b0-10a2-40fa-899c-5a435f265bb0 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:54.284885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1144/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:54.532785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.533110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.533329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.534663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1137/2281] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:54.541682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea960-bbb6-45e4-95be-816bec01f608 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.541969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea960-bbb6-45e4-95be-816bec01f608 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.542246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efea960-bbb6-45e4-95be-816bec01f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.564362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1efea960-bbb6-45e4-95be-816bec01f608 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:54.565585 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1efea960-bbb6-45e4-95be-816bec01f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.574942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1145/2282] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.586626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.588475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.648384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19733d9b-6b8f-473e-981b-c276bb15c247 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:54.652071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a27293dafee4bf88135e986f6a73fdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:54.652735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.653021 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.653290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.664479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:54.665959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f45905-5d74-48a2-a0d8-ad9a06039f5c service glance] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:54.680729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1138/2283] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:54.752944 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.753278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.753641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.755100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1146/2284] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:54.760089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1095eb-59a5-48ff-986b-f4ec317394fe None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.760578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1095eb-59a5-48ff-986b-f4ec317394fe None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.760941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1095eb-59a5-48ff-986b-f4ec317394fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.781097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8e1095eb-59a5-48ff-986b-f4ec317394fe None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:54.782291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8e1095eb-59a5-48ff-986b-f4ec317394fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.833237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1139/2285] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:08:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:54.845556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:54.847235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:54.861732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb9e84-596a-4479-9075-3b93a870bd68 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:54.865224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:54.865804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.866076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.866362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.873455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:54.875726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15a375-cf1e-45fb-8ed7-8ed8b60f9bf5 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:54.885884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1147/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:54.994378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13474-486d-41e9-9a3b-40296be7b918 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:54.994669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13474-486d-41e9-9a3b-40296be7b918 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:54.994947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca13474-486d-41e9-9a3b-40296be7b918 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:54.996365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1140/2287] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:08:55.002145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bfc25-8196-4f35-819d-1c3f1f8a7214 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:55.002436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bfc25-8196-4f35-819d-1c3f1f8a7214 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:55.003030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bfc25-8196-4f35-819d-1c3f1f8a7214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:55.029477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2f8bfc25-8196-4f35-819d-1c3f1f8a7214 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:55.030903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2f8bfc25-8196-4f35-819d-1c3f1f8a7214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:55.044569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1148/2288] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:08:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:55.056065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13474-486d-41e9-9a3b-40296be7b918 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:55.070506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca13474-486d-41e9-9a3b-40296be7b918 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:55.085716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:55.086686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:55.087087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:55.087660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:55.104642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:55.106882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:55.124079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1141/2289] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:08:58.344710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.345517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.345681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.370222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:08:58.372968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:08:58.384313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1149/2290] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:08:58.413000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:08:58.427403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f71f9-9303-48ba-894e-63a6ba626c07 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:08:58.432967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:08:58.433822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:08:58.434206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:08:58.436267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:08:58.445201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:08:58.447166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bd054-1ef1-4280-a4df-0d98f399662e service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:08:58.461435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1142/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:02.465302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:02.467913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.538553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16162a6-e420-4559-969b-143d3f682719 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.539365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16162a6-e420-4559-969b-143d3f682719 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.539670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16162a6-e420-4559-969b-143d3f682719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.564029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e16162a6-e420-4559-969b-143d3f682719 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:02.566736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e16162a6-e420-4559-969b-143d3f682719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.581724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1143/2292] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:02.587361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f61c-8ce4-46b6-9be9-02af6cb4f65c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.595422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.598102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.598941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.599586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.601890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:02.609314 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16162a6-e420-4559-969b-143d3f682719 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:02.629320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16162a6-e420-4559-969b-143d3f682719 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:02.638764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.639666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:02.641902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:02.641902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:02.641902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:02.642235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed626578-8af0-44de-8dcd-2a20e9d671ba service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.660247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:02.662221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:02.669889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1150/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:02.681535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1144/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:07.152958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.153410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.153519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.176602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:07.177914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:07.186681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1151/2295] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:07.200923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:07.213769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666b10c-90cd-4903-abfd-5f315a4cda29 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:07.219952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:07.220553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:07.220829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:07.221100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:07.231726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:07.233949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8ae5-0eef-4808-8bf9-9c132bf0dc77 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:07.244290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1145/2296] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:09:17.168351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:17.240019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=85 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:22.784819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:22.794658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8921e-3983-4aba-84f7-c79822764765 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:22.798838 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:22.799456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:22.799759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:22.800201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:22.802007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:22.881053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:22.882657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:22.895331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1152/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:30.258390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafab9f-1b4f-4389-b653-83f782937ee9 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:30.258884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafab9f-1b4f-4389-b653-83f782937ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:30.259082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafab9f-1b4f-4389-b653-83f782937ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:30.280730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1aafab9f-1b4f-4389-b653-83f782937ee9 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:30.281949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1aafab9f-1b4f-4389-b653-83f782937ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:30.289410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1146/2298] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:30.319809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:30.335793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323d80f-cea0-4212-9a28-c94a8cf8fbac service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:30.341000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:30.341615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:30.341896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:30.342167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:30.351012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:30.352632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39946bda-8067-4229-a94d-b12d6e7423fc service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:30.360707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1153/2299] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:09:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:09:36.462906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:36.463377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:36.463503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:36.483385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] MFA Rules not processed for user `bc2ab32845fc4d1bb24001127dc7b034`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:36.484624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:36.545969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1147/2300] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:40.357452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=36 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:46.538062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=28 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:09:54.282466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3375-1383-48a8-afe2-5163d66c0294 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.283053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3375-1383-48a8-afe2-5163d66c0294 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.283053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3375-1383-48a8-afe2-5163d66c0294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.304259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1edd3375-1383-48a8-afe2-5163d66c0294 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:54.305638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1edd3375-1383-48a8-afe2-5163d66c0294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:54.313988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1154/2301] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:54.336507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:54.350595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc22d-db2b-4907-a57e-d188a0857699 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:54.357017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:54.357660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:54.357930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:54.358194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:54.366897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:54.368509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:54.377906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1148/2302] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:09:57.523063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20f-9604-4161-b177-ed72537d1146 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.523449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20f-9604-4161-b177-ed72537d1146 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.523449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20f-9604-4161-b177-ed72537d1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.544231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-36d4b20f-9604-4161-b177-ed72537d1146 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:09:57.545436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-36d4b20f-9604-4161-b177-ed72537d1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:09:57.553534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1155/2303] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:09:57.592475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:09:57.603589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb1a7-40d6-4263-a6a8-483a54ba8bed service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:09:57.609413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:09:57.610006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:09:57.610288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:09:57.610563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:09:57.618676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:09:57.620717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:09:57.630115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1149/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:00.634259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406709e-6fba-4c92-8ca3-5d34727ef351 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.634786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406709e-6fba-4c92-8ca3-5d34727ef351 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.634885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406709e-6fba-4c92-8ca3-5d34727ef351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.655091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5406709e-6fba-4c92-8ca3-5d34727ef351 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:00.656355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5406709e-6fba-4c92-8ca3-5d34727ef351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:00.664440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1156/2305] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:00.700894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:00.713333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958014bb-1520-45f8-a898-063504ea1a17 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:00.719090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:00.719733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:00.720166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:00.720554 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:00.730328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:00.732135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:00.741724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1150/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:04.863639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725c17-d839-44e5-b6df-ea4b901f344e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.864441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725c17-d839-44e5-b6df-ea4b901f344e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.864441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19725c17-d839-44e5-b6df-ea4b901f344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.885353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-19725c17-d839-44e5-b6df-ea4b901f344e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:04.886946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-19725c17-d839-44e5-b6df-ea4b901f344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:04.897466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1157/2307] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:04.926412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:04.938079 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea83d-74e2-4180-9eb8-6014a658ae85 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:04.947037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:04.947700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:04.947981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:04.948906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:04.957823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:04.959512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:04.976615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1151/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:10.166618 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef88f-5bef-4f33-99ac-d13e42bb951a None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:10.167122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef88f-5bef-4f33-99ac-d13e42bb951a None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:10.167122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ef88f-5bef-4f33-99ac-d13e42bb951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:10.187912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-684ef88f-5bef-4f33-99ac-d13e42bb951a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:10.189108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-684ef88f-5bef-4f33-99ac-d13e42bb951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:10.197404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1158/2309] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Sep 7 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:10.224262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:10.237459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094caa4e-3303-4eb0-afc3-c304450d68e0 service nova] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:10.243335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:10.243967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:10.244242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:10.244508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:10.253717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:10.255294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad530ffd-1396-43b4-9ad2-313d3c6ba9b6 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:10.265164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1152/2310] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:11.486434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157649-a096-4754-9a27-2540605e9710 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:11.487002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157649-a096-4754-9a27-2540605e9710 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:11.487002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157649-a096-4754-9a27-2540605e9710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:11.506480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-02157649-a096-4754-9a27-2540605e9710 None None] MFA Rules not processed for user `7a8a52a175954db1bab6545353bb878d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:11.507742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-02157649-a096-4754-9a27-2540605e9710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:11.566215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1159/2311] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:20.260592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=30 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:21.559592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=40 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:36.658425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2b0-fc40-44ef-ada6-b9f31d0123f4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:36.658947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2b0-fc40-44ef-ada6-b9f31d0123f4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:36.658947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e2b0-fc40-44ef-ada6-b9f31d0123f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:36.679716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3df9e2b0-fc40-44ef-ada6-b9f31d0123f4 None None] MFA Rules not processed for user `1c9de09d725f48db8cc9ac13a2ca3a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:36.681161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3df9e2b0-fc40-44ef-ada6-b9f31d0123f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:36.688766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1153/2312] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:37.266283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:37.266758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:37.266974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:37.299938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] MFA Rules not processed for user `09278399bc0148e68f0c7204fe19dc59`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:37.301206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:37.365041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1160/2313] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:46.674584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:47.358234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=25 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:48.459120 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:48.459658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:48.459917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:48.480691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] MFA Rules not processed for user `809fcd4bc90440539af13ea0d1c8cb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:48.481895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:48.547884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1154/2314] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:49.988034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:49.989522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:50.005392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8c14-1fed-4979-b060-b53c5ef66ba6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:50.010479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:50.011106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:50.011385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:50.011682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] PATH_INFO: `/v3/users/bc2ab32845fc4d1bb24001127dc7b034` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:50.012798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2ab32845fc4d1bb24001127dc7b034)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:50.015336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:50.065828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2ab32845fc4d1bb24001127dc7b034'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.072285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2ab32845fc4d1bb24001127dc7b034'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.073295 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2ab32845fc4d1bb24001127dc7b034'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.074072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2ab32845fc4d1bb24001127dc7b034'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.094210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2ab32845fc4d1bb24001127dc7b034'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.108180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1161/2315] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:10:49 2022] DELETE /identity/v3/users/bc2ab32845fc4d1bb24001127dc7b034 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:10:50.285247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:50.312029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53399358-bae7-4796-aeea-7cb8f8e8648b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:50.381835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:50.382642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:50.383070 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:50.383540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] PATH_INFO: `/v3/projects/0749bc410e344d6288d8a0ec9b5ef82e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:50.384920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0749bc410e344d6288d8a0ec9b5ef82e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:50.387324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:50.441617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0749bc410e344d6288d8a0ec9b5ef82e', 'request_id': 'req-5601377b-6339-4456-831e-539884c8d8a4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.450098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0749bc410e344d6288d8a0ec9b5ef82e', 'request_id': 'req-5601377b-6339-4456-831e-539884c8d8a4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.457208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0749bc410e344d6288d8a0ec9b5ef82e', 'request_id': 'req-5601377b-6339-4456-831e-539884c8d8a4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.469193 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] The token cache is being invalidate because project 0749bc410e344d6288d8a0ec9b5ef82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:10:50.469479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.470147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:10:50.471657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1155/2316] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:10:50 2022] DELETE /identity/v3/projects/0749bc410e344d6288d8a0ec9b5ef82e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:10:55.421567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:55.423017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:55.482747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b9399-afcb-4822-8a2d-31ff265412a2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:55.537651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:55.538367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:55.538647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:55.538919 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:55.540668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:55.584113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:55.614426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:55.615937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:55.627035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1162/2317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:55.805365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:55.806841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:55.819720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601377b-6339-4456-831e-539884c8d8a4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:55.823258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:55.823916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:55.824196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:55.824467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:55.826806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:55.840294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:55.841893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:55.852917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1156/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:05.622006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=14 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:05.847907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:15.931848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:15.933384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:15.946205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845cc34-b64b-4df7-97c1-edf7a94a63bf service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:15.950038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:15.950639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:15.950921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:15.951184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:15.953801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:16.017836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:16.019298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:16.030203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1163/2319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:23.893602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:23.902616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add7398-23e6-460b-be23-431ed234f22f service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:23.907346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:23.908044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:23.908394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:23.908734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:23.910580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:23.988435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:23.989872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:23.999722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1157/2320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:26.025539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=28 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:28.114124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.116512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.189843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.191946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.208196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a9d75-ab95-4e39-bda6-c7630492b586 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.212879 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.213503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.213779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e4ed3-7099-4354-bed1-4e0b4e1aeaab service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.214461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.214944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] PATH_INFO: `/v3/users/7a8a52a175954db1bab6545353bb878d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.216477 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8a52a175954db1bab6545353bb878d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.219380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.220587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.221210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.221489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.221761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.223993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.237091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.239121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.250726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1164/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:28.273012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8a52a175954db1bab6545353bb878d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.280693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8a52a175954db1bab6545353bb878d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.282074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8a52a175954db1bab6545353bb878d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.282682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8a52a175954db1bab6545353bb878d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.290125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4d1df52b-0151-476b-a4dd-9f14615a0d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8a52a175954db1bab6545353bb878d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.307740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1158/2322] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:28 2022] DELETE /identity/v3/users/7a8a52a175954db1bab6545353bb878d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:28.477042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.488118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cde88-76c7-4e51-870e-62c4eab5de8a service placement] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.565224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.565863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.566146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.566420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] PATH_INFO: `/v3/projects/92f6a14b621f45da9791f71954929a54` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.567582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f6a14b621f45da9791f71954929a54)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.569492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.616923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f6a14b621f45da9791f71954929a54', 'request_id': 'req-099eb463-d4f8-434e-a6a0-7d5211d11741'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.628085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f6a14b621f45da9791f71954929a54', 'request_id': 'req-099eb463-d4f8-434e-a6a0-7d5211d11741'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.634599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f6a14b621f45da9791f71954929a54', 'request_id': 'req-099eb463-d4f8-434e-a6a0-7d5211d11741'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.655807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] The token cache is being invalidate because project 92f6a14b621f45da9791f71954929a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:28.656175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.656909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-099eb463-d4f8-434e-a6a0-7d5211d11741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:28.658518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1165/2323] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:28 2022] DELETE /identity/v3/projects/92f6a14b621f45da9791f71954929a54 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:28.663305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.663651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.663928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.683721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:28.684923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.744646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1159/2324] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:28.752996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.753279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.753549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.774460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:28.775917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.784006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1166/2325] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:28.788185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.798657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69862cc3-55db-482f-a5e4-6eb32fc58e97 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.803442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.804052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.804324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.804589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.805216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:28.805511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.807091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.808608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:28.822008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1160/2326] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:28.826175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.835489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c92e7-708f-4f8d-9e69-eee9332eea92 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.840127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.840713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.840986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.841250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.841897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.843799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.855101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:28.872036 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1167/2327] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:28 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:28.876833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.886897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e5cc-b2d9-4146-aa64-b72243457006 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.942887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.943707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.943991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.944258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.944920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.946897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:28.969014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1161/2328] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:28 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:28.973044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.983537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719711-9591-4cf6-aca4-1eec1c145121 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.989619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.990207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.990484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.990750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.991407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:28.993041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.006920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1168/2329] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:29.013125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.023704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050081d1-d112-4353-b5fb-912eeddb94cd admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.028383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.029155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.029504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.029835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.030593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.032413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583184d-635b-4c37-a863-513659a04a1e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.045444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1162/2330] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:29.050345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.062679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46181-04bf-41ee-8baf-0a452e8396db admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.068467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.069337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.069622 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.069906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] PATH_INFO: `/v3/projects/732ada711a6b49d1bf37c3ce64ef697d/users/507e4dd1a21242e59f48521ca7fb2a46/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.070614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.070963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.071297 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.085379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732ada711a6b49d1bf37c3ce64ef697d, user_id=507e4dd1a21242e59f48521ca7fb2a46, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.088045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df71dd-368a-4ffb-a1a2-e902f63e1b42 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.090829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:29.092043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.102358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1169/2331] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:29 2022] PUT /identity/v3/projects/732ada711a6b49d1bf37c3ce64ef697d/users/507e4dd1a21242e59f48521ca7fb2a46/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:29.114691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.115253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.115493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.144695 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] MFA Rules not processed for user `507e4dd1a21242e59f48521ca7fb2a46`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:29.145825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.149067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:29.198765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.200236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.214785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1170/2333] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:29.219773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.274009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68ab92-dae2-43a9-9b69-a83bea42ffc8 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.284384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7df38e-e403-4bab-87c2-6c23e5ef7323 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.289205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.289806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.290079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.290344 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.290963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.291400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:29.292882 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.322531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1171/2334] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:29.326493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.337840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.338456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.338924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.339081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.363653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:29.395200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ca405-0641-4f43-b98c-4dc4c3ae39ae admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.400204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.401866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.401866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.401866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.402186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.403918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.413938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.415847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.427944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1164/2335] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:11:29.431713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1172/2336] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:29.432802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.444155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93654f3-806f-4fb1-96d5-4968af5e2860 service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.449028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.450090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.450090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.450462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.451196 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.453732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.464580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1165/2337] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:29.469645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.480166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01551b39-fd28-4bf0-8e4e-133c17cf6667 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.486600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.487260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.487574 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.487897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] PATH_INFO: `/v3/projects/2d6aee2023ed4b80959cb66582f156d7/users/b297d86c079046568bf75ba26ae0e263/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.505214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6aee2023ed4b80959cb66582f156d7, user_id=b297d86c079046568bf75ba26ae0e263, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.507954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.527962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1173/2338] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:29 2022] PUT /identity/v3/projects/2d6aee2023ed4b80959cb66582f156d7/users/b297d86c079046568bf75ba26ae0e263/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:29.532578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.543114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39dc6f-97ca-4289-ac88-e1112d890065 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.607906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.608556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.609392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.609658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.610368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.612127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6dcb16-a9e3-4b66-9a62-b14a842bbd5e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.622448 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1166/2339] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:29.627989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.639619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5510c-d7f7-4e01-8a51-ca7f0ed3fcb9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.644708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.645437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.645659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.645932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] PATH_INFO: `/v3/projects/2d6aee2023ed4b80959cb66582f156d7/users/b297d86c079046568bf75ba26ae0e263/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.647881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6aee2023ed4b80959cb66582f156d7, user_id=b297d86c079046568bf75ba26ae0e263, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.651000 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.663091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1174/2340] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:29 2022] PUT /identity/v3/projects/2d6aee2023ed4b80959cb66582f156d7/users/b297d86c079046568bf75ba26ae0e263/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:29.675072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.675478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.675780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.706298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] MFA Rules not processed for user `b297d86c079046568bf75ba26ae0e263`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:29.707653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.743423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:29.781946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1167/2341] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:29.793006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:29.794742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.861363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341fa75-824c-419f-bb19-349341bf5acb admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:29.865096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:29.865729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:29.866007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:29.866276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:29.927900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.929518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.939490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1175/2342] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:32.582905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:32.594615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a121e-0f08-4c74-98f3-f147346a1fed None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:32.598401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:32.599007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:32.599292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:32.599944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:32.620552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:32.622148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:32.634496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1168/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:36.397263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:36.398723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:36.447795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:36.474050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037cb80-fa1f-4140-87b0-44bd851ee134 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:36.478555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:36.479178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:36.479457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:36.479768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] PATH_INFO: `/v3/users/7ce0eb5b229b4b7790850a02044f6884` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:36.480911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce0eb5b229b4b7790850a02044f6884)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:36.482798 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:36.529069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce0eb5b229b4b7790850a02044f6884'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.539268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce0eb5b229b4b7790850a02044f6884'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.539852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce0eb5b229b4b7790850a02044f6884'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.540460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce0eb5b229b4b7790850a02044f6884'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.553428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce0eb5b229b4b7790850a02044f6884'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.572266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1176/2344] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:36 2022] DELETE /identity/v3/users/7ce0eb5b229b4b7790850a02044f6884 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:36.769878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:36.784139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286589-a688-42f2-ba1c-dbe1a4e58e60 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:36.847524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:36.848088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:36.848652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:36.848781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] PATH_INFO: `/v3/projects/70d4a73b6a6f46808799d0de7261c80c` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:36.849888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d4a73b6a6f46808799d0de7261c80c)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:36.853732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:36.905176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d4a73b6a6f46808799d0de7261c80c', 'request_id': 'req-b65dfa58-3804-4be5-92ac-7ffc70992e2f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.912438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d4a73b6a6f46808799d0de7261c80c', 'request_id': 'req-b65dfa58-3804-4be5-92ac-7ffc70992e2f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.918131 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d4a73b6a6f46808799d0de7261c80c', 'request_id': 'req-b65dfa58-3804-4be5-92ac-7ffc70992e2f'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.929840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] The token cache is being invalidate because project 70d4a73b6a6f46808799d0de7261c80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:36.930130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.930772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:36.932301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1169/2345] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:36 2022] DELETE /identity/v3/projects/70d4a73b6a6f46808799d0de7261c80c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:36.936592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:36.938894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:36.954460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ff316-90cb-435a-b524-7e7e2879b2f7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:37.017666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:37.018358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:37.018636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:37.018909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] PATH_INFO: `/v3/users/c2e5fc5b12404f098baac30e2bfc84ee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:37.020105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e5fc5b12404f098baac30e2bfc84ee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:37.022211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:37.070111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e5fc5b12404f098baac30e2bfc84ee'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.077692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e5fc5b12404f098baac30e2bfc84ee'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.078340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e5fc5b12404f098baac30e2bfc84ee'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.079002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e5fc5b12404f098baac30e2bfc84ee'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.083543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:37.093890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e5fc5b12404f098baac30e2bfc84ee'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.106293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1177/2346] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:36 2022] DELETE /identity/v3/users/c2e5fc5b12404f098baac30e2bfc84ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:37.283341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:37.284801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:37.298351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfa58-3804-4be5-92ac-7ffc70992e2f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:37.345865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:37.362293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:37.362927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:37.363206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:37.363501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] PATH_INFO: `/v3/projects/941590379f5a41f3aa5f2bb255749e4d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:37.364619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941590379f5a41f3aa5f2bb255749e4d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:37.366532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:37.413900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941590379f5a41f3aa5f2bb255749e4d', 'request_id': 'req-18e2c229-f526-46e3-80ce-1324ac23c1c0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.422894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941590379f5a41f3aa5f2bb255749e4d', 'request_id': 'req-18e2c229-f526-46e3-80ce-1324ac23c1c0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.428955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941590379f5a41f3aa5f2bb255749e4d', 'request_id': 'req-18e2c229-f526-46e3-80ce-1324ac23c1c0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.441095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] The token cache is being invalidate because project 941590379f5a41f3aa5f2bb255749e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:37.441521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.442184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:37.443942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1170/2347] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:37 2022] DELETE /identity/v3/projects/941590379f5a41f3aa5f2bb255749e4d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:40.623796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:40.625220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:40.703951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71881ab-1ebd-4ba1-bc38-245ae5fe3d55 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:40.768513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:40.769035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:40.769313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:40.769580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:40.771356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:40.829294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:40.831728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939e88d-86a5-41b4-8f7f-82200ac84bdd service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:40.841181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1178/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:45.468302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:45.469291 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:45.574368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c229-f526-46e3-80ce-1324ac23c1c0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:45.580109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:45.581249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:45.581626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:45.582639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] PATH_INFO: `/v3/users/507e4dd1a21242e59f48521ca7fb2a46` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:45.591185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507e4dd1a21242e59f48521ca7fb2a46)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:45.593495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:45.648805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507e4dd1a21242e59f48521ca7fb2a46'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:45.656391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507e4dd1a21242e59f48521ca7fb2a46'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:45.657189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507e4dd1a21242e59f48521ca7fb2a46'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:45.658728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507e4dd1a21242e59f48521ca7fb2a46'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:45.666475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507e4dd1a21242e59f48521ca7fb2a46'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:45.681906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:45.687720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1171/2349] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:45 2022] DELETE /identity/v3/users/507e4dd1a21242e59f48521ca7fb2a46 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:45.692505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:45.692997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:45.693093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:45.713522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:45.714758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:45.720240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:45.780726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1179/2350] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:45.792606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:45.794104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:45.868764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ed7c5-2b6e-4f22-a049-f8e2149eb727 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:45.872646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:45.873339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:45.873687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:45.874030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:45.886994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:45.888764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:45.911645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:45.913265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:45.921433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1172/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:46.093339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ecd0f-feeb-4a13-9982-b6e085b4c0e2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:46.106978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:46.108257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:46.108830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:46.109515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:46.114077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:46.134163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:46.136368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:46.151663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1180/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:46.375824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:46.377476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:46.395780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e14-f5da-4898-a7af-c057b0ae10e3 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:46.400456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:46.401146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:46.401507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:46.401837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] PATH_INFO: `/v3/projects/732ada711a6b49d1bf37c3ce64ef697d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:46.403012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=732ada711a6b49d1bf37c3ce64ef697d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:46.405056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:46.466462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732ada711a6b49d1bf37c3ce64ef697d', 'request_id': 'req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.475585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732ada711a6b49d1bf37c3ce64ef697d', 'request_id': 'req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.481362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732ada711a6b49d1bf37c3ce64ef697d', 'request_id': 'req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.493839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] The token cache is being invalidate because project 732ada711a6b49d1bf37c3ce64ef697d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:46.494152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.494781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.496546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1173/2353] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:46 2022] DELETE /identity/v3/projects/732ada711a6b49d1bf37c3ce64ef697d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:46.500403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:46.511146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4e6e-124e-4600-b42c-8d3e016c5f87 service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:46.581425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:46.581677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:46.581964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:46.582238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] PATH_INFO: `/v3/users/b297d86c079046568bf75ba26ae0e263` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:46.583404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b297d86c079046568bf75ba26ae0e263)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:46.585485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:46.657592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:46.667410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b297d86c079046568bf75ba26ae0e263'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.683557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b297d86c079046568bf75ba26ae0e263'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.684192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b297d86c079046568bf75ba26ae0e263'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.684801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b297d86c079046568bf75ba26ae0e263'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.701259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b297d86c079046568bf75ba26ae0e263'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:46.720377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1181/2354] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:46 2022] DELETE /identity/v3/users/b297d86c079046568bf75ba26ae0e263 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:46.905006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:46.906481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.051029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bdfbc-dbae-46a6-a246-6d29e8bd709b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.070711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:47.093242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.094831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.129966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.130720 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.131394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.131660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.133568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.195640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a219e-e437-40ab-99a0-cf834b036f2f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.200433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.201096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.201362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.201632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] PATH_INFO: `/v3/projects/2d6aee2023ed4b80959cb66582f156d7` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.203009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6aee2023ed4b80959cb66582f156d7)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.205525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.205880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.207663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce0466b-158f-4f79-9508-ebdd37bc62e9 service nova] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.217812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1174/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:47.263414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6aee2023ed4b80959cb66582f156d7', 'request_id': 'req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:47.271765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6aee2023ed4b80959cb66582f156d7', 'request_id': 'req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:47.278675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6aee2023ed4b80959cb66582f156d7', 'request_id': 'req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:47.291161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] The token cache is being invalidate because project 2d6aee2023ed4b80959cb66582f156d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:47.291503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:47.292251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-cbea0f97-6fd4-4a15-a8d8-d07898e27e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:47.293915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1182/2356] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:47 2022] DELETE /identity/v3/projects/2d6aee2023ed4b80959cb66582f156d7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:47.298651 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.299119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.299399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.321959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:47.323176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.395768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1175/2357] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:47.403607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.403891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.404161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.425555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:47.427287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.436084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1183/2358] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:47.442567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.452168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638ce2-1fb3-40cf-944b-e2e8247a72d2 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.458835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.459580 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.459920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.460186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.460951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:47.461510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.463268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.476823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1176/2359] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:47.481240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.494565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e7e8-5544-44b0-bdce-f9ac1cefeaf1 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.500368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.501195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.501731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.502782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.503785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.506039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.546686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1184/2360] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:47.552553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.567369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cff0f-2869-4ea8-b3f3-bebcb3083f21 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.615268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:47.629715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.630319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.630599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.630871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.631565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.633674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.653887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1177/2361] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:47.658088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.668941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3e467-cd61-4d75-b34f-8a9583d8317d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.674287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.675037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.675341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.675647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.676274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.678127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.689112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1185/2362] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:47.694081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.704403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8c42-a330-429f-bf04-77cdfd75b4e5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.710075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.710832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.711109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.711380 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.712056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.713657 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79014cbc-7394-4ebe-9019-1db7305e93fd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.724801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1178/2363] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:47.728881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.739511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdc5d7-1433-46ad-981b-ed860bdebe30 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:47.744154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:47.744791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.745088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.745367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] PATH_INFO: `/v3/projects/a2f1135c827140b4aee17054fe03f9de/users/610f5793631d4795b9774c63a4b5d8ea/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.747614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:47.765597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f1135c827140b4aee17054fe03f9de, user_id=610f5793631d4795b9774c63a4b5d8ea, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:47.768822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:47.789258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1186/2364] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:47 2022] PUT /identity/v3/projects/a2f1135c827140b4aee17054fe03f9de/users/610f5793631d4795b9774c63a4b5d8ea/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:47.800128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.800443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.800721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.831007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] MFA Rules not processed for user `610f5793631d4795b9774c63a4b5d8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:47.832253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.901585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1179/2365] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:47.906168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.000914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc57e4-d8ca-4332-8459-dd861f2cf002 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.006573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.007205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.007523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.007802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.008449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.010338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.042302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1187/2366] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:48.043455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.054830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea2dd0-25f1-4929-ab75-766ee6968fdf None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.124381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.124997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.125278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.125552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.126189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.129081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.152007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1180/2367] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:48 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:48.156322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.167438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38d18f-e6d9-4169-bd3e-c9af37029fcd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.172170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.172768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.173050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.173322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.173965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.177081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.188902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1188/2368] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:48.193806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.204433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac593-9aea-4799-908b-4b98f5ee6eb0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.210354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.211018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.211401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.211711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] PATH_INFO: `/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b/users/625aacaf927a4a7587396b2225bf9d3d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.227703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdf6582d77b41059e2ecadb5c27db3b, user_id=625aacaf927a4a7587396b2225bf9d3d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.230423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.245762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1181/2369] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:48 2022] PUT /identity/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b/users/625aacaf927a4a7587396b2225bf9d3d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:48.249626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.261709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5927be-c0ac-4bed-986c-e8261804f2cb admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.327858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.328505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.328787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.329058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.329709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.331392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5921-c404-462c-aed5-9415349f34a6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.341851 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1189/2370] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:48.346033 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.356411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be126f18-a7ac-4a42-b082-062cc98b1aa6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.362355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.362947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.363176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.363562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] PATH_INFO: `/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b/users/625aacaf927a4a7587396b2225bf9d3d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.365876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bdf6582d77b41059e2ecadb5c27db3b, user_id=625aacaf927a4a7587396b2225bf9d3d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.368589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.383981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1182/2371] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:48 2022] PUT /identity/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b/users/625aacaf927a4a7587396b2225bf9d3d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:48.394276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.394562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.394840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.422999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] MFA Rules not processed for user `625aacaf927a4a7587396b2225bf9d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:48.424809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:48.471159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:48.500021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1190/2372] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:48.512880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.514640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:48.533757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:48.588302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f19279-1a55-4567-831a-2beda160d121 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.591999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.592610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.592901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.594447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.610332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.610332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bac93c-c836-4211-ae50-662e7f23be66 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.623980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1183/2373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:48.657175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.735026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffd75e-5eea-47d5-ad76-26c155d7c65c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.741499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.742168 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.742434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.742702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] PATH_INFO: `/v3/users/610f5793631d4795b9774c63a4b5d8ea` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.743954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610f5793631d4795b9774c63a4b5d8ea)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.746754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.814078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610f5793631d4795b9774c63a4b5d8ea'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:48.823018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610f5793631d4795b9774c63a4b5d8ea'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:48.823770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610f5793631d4795b9774c63a4b5d8ea'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:48.824455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610f5793631d4795b9774c63a4b5d8ea'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:48.838014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610f5793631d4795b9774c63a4b5d8ea'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:48.854407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1191/2374] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:48 2022] DELETE /identity/v3/users/610f5793631d4795b9774c63a4b5d8ea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:48.859081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.859363 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.859695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.883148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:48.884422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:48.973928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1184/2375] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:48.980697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:48.982802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:49.057974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c2fee-35f5-47e3-b103-f026e88708d2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:49.063297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:49.066095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:49.066809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:49.067081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:49.079554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:49.082245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:49.089215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:49.098820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1192/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:49.580914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:49.582742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:49.597100 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be063b-4ee1-4be0-af8d-f9d7fea3879e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:49.604518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:49.605555 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:49.606140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:49.606547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] PATH_INFO: `/v3/projects/a2f1135c827140b4aee17054fe03f9de` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:49.616029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f1135c827140b4aee17054fe03f9de)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:49.618205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:49.669762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f1135c827140b4aee17054fe03f9de', 'request_id': 'req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.679226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f1135c827140b4aee17054fe03f9de', 'request_id': 'req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.686042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f1135c827140b4aee17054fe03f9de', 'request_id': 'req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.700423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] The token cache is being invalidate because project a2f1135c827140b4aee17054fe03f9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:49.700774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.701684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1583307a-c9b3-4ac2-ad2a-4f6bcb9fcc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.703652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1185/2377] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:49 2022] DELETE /identity/v3/projects/a2f1135c827140b4aee17054fe03f9de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:49.708615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:49.720887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01688814-72e8-48a6-97d0-2abfc9f369de service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:49.786674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:49.787353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:49.787654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:49.787929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] PATH_INFO: `/v3/users/625aacaf927a4a7587396b2225bf9d3d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:49.789092 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=625aacaf927a4a7587396b2225bf9d3d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:49.791020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:49.842375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625aacaf927a4a7587396b2225bf9d3d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.850877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625aacaf927a4a7587396b2225bf9d3d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.851085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625aacaf927a4a7587396b2225bf9d3d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.851665 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625aacaf927a4a7587396b2225bf9d3d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.867019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625aacaf927a4a7587396b2225bf9d3d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:49.880858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1193/2378] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:49 2022] DELETE /identity/v3/users/625aacaf927a4a7587396b2225bf9d3d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:50.147642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c9a9b-ddcb-44a8-90a8-468d25a7ac1c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.148094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c9a9b-ddcb-44a8-90a8-468d25a7ac1c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.148457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c9a9b-ddcb-44a8-90a8-468d25a7ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.174670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1f6c9a9b-ddcb-44a8-90a8-468d25a7ac1c None None] MFA Rules not processed for user `1c9de09d725f48db8cc9ac13a2ca3a52`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:50.176617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1f6c9a9b-ddcb-44a8-90a8-468d25a7ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.188889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.190707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.229813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:50.264386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1186/2379] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:50.279491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b433019-233a-4c58-b64f-93fa561bb8d2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.285911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.286441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.286911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.287384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] PATH_INFO: `/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.289215 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bdf6582d77b41059e2ecadb5c27db3b)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.292028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.321596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:50.348929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bdf6582d77b41059e2ecadb5c27db3b', 'request_id': 'req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:50.357292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bdf6582d77b41059e2ecadb5c27db3b', 'request_id': 'req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:50.363990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bdf6582d77b41059e2ecadb5c27db3b', 'request_id': 'req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:50.375651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] The token cache is being invalidate because project 8bdf6582d77b41059e2ecadb5c27db3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:50.375941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:50.376625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c7697a0f-e5dc-4129-bde7-1f481a2e2d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:50.378284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1194/2380] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:50 2022] DELETE /identity/v3/projects/8bdf6582d77b41059e2ecadb5c27db3b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:50.383082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.383425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.383735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.404020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:50.405235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.467281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1187/2381] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:50.477121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.477406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.477682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.498106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:50.499328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.507981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1195/2382] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:50.512186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.524465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742d815-5592-4fb9-bf3a-2f9abedd89bd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.532240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.532795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.533687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.533960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.534610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:50.534908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.536801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.548903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1188/2383] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:50.553941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.563309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea2d3c-2ec9-462d-ae48-df8331449f02 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.568559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.569290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.569568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.569836 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.570459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.572366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.590987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.592797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.603508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1196/2384] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:50.605287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.656964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f5336-1bd9-4e1a-9d5d-aa8ba2d7d904 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.683508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03ec1-7d9c-4c1c-92b1-ec6b6141ce30 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.688425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.689068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.689474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.689746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.690595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.692534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.717266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1197/2385] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:50.717677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.718410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.718695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.718963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.721727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.722473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.733533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.733943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcec69-3ccb-4dad-ba3f-006e3dfc6c55 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.734981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.739452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.740109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.740391 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.740662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.741296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.742885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.744624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1189/2386] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:50.754656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1198/2387] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:50.758793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.775405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e66fbd-2e91-4233-bbe8-8f3312993078 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.782353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.783476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.783937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.784422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.785137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.786898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1432-0475-4cd8-8a50-addf81167e95 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.797621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1190/2388] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:50.802183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:50.814326 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d87e7-c6b3-482a-9312-e9d0b95577e2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:50.823485 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:50.824155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.824430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.824706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] PATH_INFO: `/v3/projects/634d0d51ce65403c993729479bdd8564/users/0fb53e324f4a41598f74b5696a916113/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.840789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] RBAC: Authorizing `identity:create_grant(project_id=634d0d51ce65403c993729479bdd8564, user_id=0fb53e324f4a41598f74b5696a916113, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:50.843423 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:50.858199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1199/2389] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:50 2022] PUT /identity/v3/projects/634d0d51ce65403c993729479bdd8564/users/0fb53e324f4a41598f74b5696a916113/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:50.869023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012742-e67f-406f-8699-d10a8ebfd51d None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:50.869392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012742-e67f-406f-8699-d10a8ebfd51d None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:50.869735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96012742-e67f-406f-8699-d10a8ebfd51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:50.896476 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:50.899813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-96012742-e67f-406f-8699-d10a8ebfd51d None None] MFA Rules not processed for user `0fb53e324f4a41598f74b5696a916113`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:50.901609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-96012742-e67f-406f-8699-d10a8ebfd51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:50.970004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1191/2390] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:50.974722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.014933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:51.041573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08d23-bfcb-41c3-a3da-efd110f2706d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.054839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.055683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.056027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.056376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.057123 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.059119 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.087760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ddb70-3d48-4559-8e80-8bbbb481c6c9 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.088047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ddb70-3d48-4559-8e80-8bbbb481c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.088320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ddb70-3d48-4559-8e80-8bbbb481c6c9 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.089677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1192/2391] 10.222.0.18 () {54 vars in 961 bytes} [Wed Sep 7 13:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:51.094535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.094813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.095086 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.095199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1200/2392] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:50 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:51.099558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.116381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] MFA Rules not processed for user `446b38e21f4a48f29107e4a6deb1ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:51.117590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.172553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf96b3-3643-4b2e-be08-da5ce02aec4a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.178545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.179386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.179815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.180094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.180731 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.182773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.211160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1193/2393] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Sep 7 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:51.211974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1201/2394] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:51 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:51.218786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.219039 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.230465 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23170cd9-3bef-4942-876d-9bc96da31eb5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.232510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88da04a-a6a5-4f27-bdcd-8fca86934f07 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.238085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.238229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.238799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.239519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.239702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.239829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.240130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.240541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.241391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.241729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.243145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.254920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1194/2395] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:51.259307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.261452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.263184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.270641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482f4de-fa8c-4057-a08e-34a596cc5309 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.275165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1202/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:51.276271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.276977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.277262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.277539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] PATH_INFO: `/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f/users/f66a622be6ff4724b8be459710460eca/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.294468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e7fe82a5e24184ac956a47bb4b071f, user_id=f66a622be6ff4724b8be459710460eca, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.297815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.314768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1195/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:51 2022] PUT /identity/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f/users/f66a622be6ff4724b8be459710460eca/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:51.318758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.330114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad651a-c1e7-434b-9371-4b7807dd6643 service placement] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.396159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.396809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.397023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.397318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.397915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.399489 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63491503-6845-4d03-aee7-48a2367b06aa admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.411348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1203/2398] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:51.415352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.428338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf490983-975e-4fa8-bfa7-54c2642f47e3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.442984 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.443674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.443949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.444277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] PATH_INFO: `/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f/users/f66a622be6ff4724b8be459710460eca/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.446199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e7fe82a5e24184ac956a47bb4b071f, user_id=f66a622be6ff4724b8be459710460eca, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.448990 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.462371 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1196/2399] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:51 2022] PUT /identity/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f/users/f66a622be6ff4724b8be459710460eca/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:51.478754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.479035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.479302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.513161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] MFA Rules not processed for user `f66a622be6ff4724b8be459710460eca`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:51.514583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.550524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:51.628463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1204/2400] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:51.637631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.640147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.719863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8adcee-2fb5-4bc8-aed3-df788ac26c38 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.726228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:51.726426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.726642 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.726889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.733425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:51.738114 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:51.739863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:51.751208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1197/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:52.108889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.118957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e3337-f50f-4262-8059-950ac892512c None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:52.123633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a622be6ff4724b8be459710460eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0e7fe82a5e24184ac956a47bb4b071f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.124225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.124509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.124783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.125429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:52.125734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.128174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.139675 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1205/2402] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:52.143993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.153140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de3638-509e-43da-a4a6-dd91200fd47e service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:52.158073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a622be6ff4724b8be459710460eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0e7fe82a5e24184ac956a47bb4b071f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.158948 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.159262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.159574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.160214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.162402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.192675 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1198/2403] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:52 2022] POST /identity/v3/projects => generated 353 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:52.196937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.207385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89ff6-ae6c-4d1c-a983-7cf143c71721 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:52.268266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a622be6ff4724b8be459710460eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0e7fe82a5e24184ac956a47bb4b071f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.268890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.269158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.269435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.270077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:52.270384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.272041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.284219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1206/2404] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:52.325533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.336506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9b7a7-a968-4ab3-b763-0ad25566cba4 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:52.341894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a622be6ff4724b8be459710460eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0e7fe82a5e24184ac956a47bb4b071f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.342653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.342933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.343203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] PATH_INFO: `/v3/projects/829447b18ca945878c3c4577ec54fd76` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.344342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorizing `identity:delete_project(project_id=829447b18ca945878c3c4577ec54fd76)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.346766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.401161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829447b18ca945878c3c4577ec54fd76', 'request_id': 'req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.410285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829447b18ca945878c3c4577ec54fd76', 'request_id': 'req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.416036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829447b18ca945878c3c4577ec54fd76', 'request_id': 'req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.429531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] The token cache is being invalidate because project 829447b18ca945878c3c4577ec54fd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:52.429932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.430510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-78ebcfe2-bb46-4fd4-876f-2bccd9e2fdd0 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.432265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1199/2405] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:52 2022] DELETE /identity/v3/projects/829447b18ca945878c3c4577ec54fd76 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:52.681041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.682756 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.751431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6635f10-1224-459e-ac8c-2e76774b3f93 tempest-VolumeQuotaClassesTest-118921598 tempest-VolumeQuotaClassesTest-118921598-project-admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:52.802634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.818766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.819415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.819726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.820005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] PATH_INFO: `/v3/users/0fb53e324f4a41598f74b5696a916113` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.821257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb53e324f4a41598f74b5696a916113)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.823150 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.879601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb53e324f4a41598f74b5696a916113'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.887514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb53e324f4a41598f74b5696a916113'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.888199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb53e324f4a41598f74b5696a916113'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.888809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb53e324f4a41598f74b5696a916113'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.903593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb53e324f4a41598f74b5696a916113'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:52.917393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1207/2406] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:52 2022] DELETE /identity/v3/users/0fb53e324f4a41598f74b5696a916113 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:52.921958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.922565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.922565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.945845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:52.947228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:53.028771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1200/2407] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:53.037185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:53.038783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:53.131146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb9700-548e-45ca-b41f-59dd420bff1c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:53.136100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:53.136712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:53.136993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:53.137283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:53.152169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:53.154367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:53.169074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1208/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:53.543109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:53.545829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:53.567769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81da73-0815-44e6-8aaa-c242966ee704 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:53.580983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:53.581562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:53.582047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:53.582254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] PATH_INFO: `/v3/projects/634d0d51ce65403c993729479bdd8564` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:53.583226 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634d0d51ce65403c993729479bdd8564)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:53.585294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:53.634876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634d0d51ce65403c993729479bdd8564', 'request_id': 'req-20fe7e55-cd88-4450-9a2c-0bb4ea030368'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.636895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.647414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634d0d51ce65403c993729479bdd8564', 'request_id': 'req-20fe7e55-cd88-4450-9a2c-0bb4ea030368'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.656816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634d0d51ce65403c993729479bdd8564', 'request_id': 'req-20fe7e55-cd88-4450-9a2c-0bb4ea030368'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.680861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] The token cache is being invalidate because project 634d0d51ce65403c993729479bdd8564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:53.681157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.681828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.683827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1201/2409] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:53 2022] DELETE /identity/v3/projects/634d0d51ce65403c993729479bdd8564 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:53.687615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:53.697727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3c92-759d-468f-b91a-6feb8d9b08ce service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:53.768256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:53.769185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:53.769782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:53.770141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] PATH_INFO: `/v3/users/f66a622be6ff4724b8be459710460eca` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:53.771660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66a622be6ff4724b8be459710460eca)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:53.773604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:53.785699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.827754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66a622be6ff4724b8be459710460eca'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.836604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66a622be6ff4724b8be459710460eca'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.837372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66a622be6ff4724b8be459710460eca'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.838031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66a622be6ff4724b8be459710460eca'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.851681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66a622be6ff4724b8be459710460eca'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:53.863884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1209/2410] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:53 2022] DELETE /identity/v3/users/f66a622be6ff4724b8be459710460eca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:11:53.890010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:53.891785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:53.972081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe7e55-cd88-4450-9a2c-0bb4ea030368 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.028538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.029240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.030788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.031069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.033174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:54.043087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.044565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a2205-104f-4362-ae06-fd0299d3c747 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.054403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1202/2411] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:54.165933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.167491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:54.249956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae54e6f-52a6-4a92-aab0-9c4433e6c98c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.259801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.260483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.260769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.261046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] PATH_INFO: `/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.262241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e7fe82a5e24184ac956a47bb4b071f)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.264484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.314968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e7fe82a5e24184ac956a47bb4b071f', 'request_id': 'req-fde2708d-b2ee-4381-b353-ed50168725fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:54.324347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e7fe82a5e24184ac956a47bb4b071f', 'request_id': 'req-fde2708d-b2ee-4381-b353-ed50168725fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:54.330152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e7fe82a5e24184ac956a47bb4b071f', 'request_id': 'req-fde2708d-b2ee-4381-b353-ed50168725fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:54.343205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] The token cache is being invalidate because project c0e7fe82a5e24184ac956a47bb4b071f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:54.343439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:54.344200 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fde2708d-b2ee-4381-b353-ed50168725fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:54.345920 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1210/2412] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:54 2022] DELETE /identity/v3/projects/c0e7fe82a5e24184ac956a47bb4b071f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:54.351326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.351838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.352029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.381118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:54.382366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:54.454776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1203/2413] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:54.464038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.464325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.464591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.485633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:54.487442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:54.496804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1211/2414] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:54.500913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.512176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2c1da-4cc8-4d94-8d73-1ab6a92d5f20 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.519532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.519532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.519532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.519532 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.520040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:54.520040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.523877 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.540107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1204/2415] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:54.541663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.553407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca467b-1d94-41c8-a3d8-c075a4b5e689 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.559256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.560062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.560442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.560830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.561655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.563720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.579358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:54.606589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1212/2416] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:54.611633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.653015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba6c5-d942-4cbe-a52b-f1ea4b69ff1d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.678595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:54.721506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.722288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.722664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.723002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.723773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.725801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.754485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1205/2417] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:54.755739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.768159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafd5f4-f7f9-48e0-9eed-2441aebe506e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.773717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.774481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.774764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.775050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.775708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.777296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.791542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1213/2418] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:54.798379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.810781 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a043aa-691e-4017-9d1e-8eae2e789858 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.815855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.816455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.816727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.816992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.817621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.819207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434f333-86d6-4102-8ce7-4412c84c5f9e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.829608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1206/2419] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:54.833915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:54.844174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2dbc7-d278-47b5-9590-ca90dc05258a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:54.849419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:54.850077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.850356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.850785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] PATH_INFO: `/v3/projects/f6f1289386aa42cfb6a11fd3fe74c3a3/users/ff8acc601c944c2aba5d9f32b4018016/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.868954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f1289386aa42cfb6a11fd3fe74c3a3, user_id=ff8acc601c944c2aba5d9f32b4018016, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:54.872133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:54.892602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1214/2420] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:54 2022] PUT /identity/v3/projects/f6f1289386aa42cfb6a11fd3fe74c3a3/users/ff8acc601c944c2aba5d9f32b4018016/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:54.904075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.904687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.905133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.937073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] MFA Rules not processed for user `ff8acc601c944c2aba5d9f32b4018016`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:54.938370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:55.014378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1207/2421] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:55.019667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.084212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af348ca4-403c-4020-bd5d-ec9e89e0117f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.088959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.089569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.089849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.090121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.090761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.092847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.120786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1215/2422] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:55 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:55.124951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.136700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0576ed9-f5d7-40a5-97f1-7211c10ea041 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.196633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.197434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.197734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.198139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.198787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.200757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.225489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1208/2423] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:55 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:55.229702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.241520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d356-f0ad-4ea9-95af-729b9455e6b4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.246590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.247194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.247496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.247768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.248407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.250002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.263360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1216/2424] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:55.268252 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.280283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e772-7d99-4dba-8fac-cac39909e5e8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.285407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.286206 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.286328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.286609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] PATH_INFO: `/v3/projects/c9b2329cf59a4974b5835aedd7af1532/users/f2c7e4a900c04f5195cdc71f8f34b90a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.305298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b2329cf59a4974b5835aedd7af1532, user_id=f2c7e4a900c04f5195cdc71f8f34b90a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.308703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.319918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:55.331540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1209/2425] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:55 2022] PUT /identity/v3/projects/c9b2329cf59a4974b5835aedd7af1532/users/f2c7e4a900c04f5195cdc71f8f34b90a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:55.333528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.356073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a805-b197-4c6d-a086-b702967c5b10 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.421507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.422113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.422386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.422651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.423403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.426037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121b67f-9526-401c-ac03-beda5eeec93d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.436587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1217/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:55.441844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.452290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ae159-2144-4977-8ea0-668679538ba4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.458073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.458810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.459152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.459497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] PATH_INFO: `/v3/projects/c9b2329cf59a4974b5835aedd7af1532/users/f2c7e4a900c04f5195cdc71f8f34b90a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.461490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b2329cf59a4974b5835aedd7af1532, user_id=f2c7e4a900c04f5195cdc71f8f34b90a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.464239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.475980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1210/2427] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:55 2022] PUT /identity/v3/projects/c9b2329cf59a4974b5835aedd7af1532/users/f2c7e4a900c04f5195cdc71f8f34b90a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:55.487087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.487383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.487676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.516174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] MFA Rules not processed for user `f2c7e4a900c04f5195cdc71f8f34b90a`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:55.518194 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:55.530992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:55.590272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1218/2428] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:55.602897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.604616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:55.678743 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f43c5-a341-4007-aa74-7c7b4d575984 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.680456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.680456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.680456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.680796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.695716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.697308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d7cdf-569e-470f-84fb-4f7b563df8a1 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.712559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1211/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:55.870711 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.939553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c072-76a9-4368-9d80-1a93b9f0cafb None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.944228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.944870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.945130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.945397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] PATH_INFO: `/v3/users/ff8acc601c944c2aba5d9f32b4018016` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.946625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff8acc601c944c2aba5d9f32b4018016)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.948754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:56.000624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff8acc601c944c2aba5d9f32b4018016'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.009403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff8acc601c944c2aba5d9f32b4018016'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.010060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff8acc601c944c2aba5d9f32b4018016'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.010661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff8acc601c944c2aba5d9f32b4018016'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.023998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff8acc601c944c2aba5d9f32b4018016'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.038431 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1219/2430] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:55 2022] DELETE /identity/v3/users/ff8acc601c944c2aba5d9f32b4018016 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:56.043029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:56.043559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:56.043660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:56.071283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:56.072756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:56.133688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1212/2431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:56.143566 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:56.145251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:56.187447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:56.218389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4adde3-8f97-423a-9591-4131464094af admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:56.222700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:56.223310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:56.223634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:56.223909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:56.233908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:56.235343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:56.246357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1220/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:56.608258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:56.609742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:56.631993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f669d-c132-4631-ae3f-f5e5f2eb3df2 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:56.637087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:56.637725 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:56.638003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:56.638273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] PATH_INFO: `/v3/projects/f6f1289386aa42cfb6a11fd3fe74c3a3` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:56.639395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f1289386aa42cfb6a11fd3fe74c3a3)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:56.641519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:56.692301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f1289386aa42cfb6a11fd3fe74c3a3', 'request_id': 'req-be928461-e4f5-4d74-bc5d-fd707f34ae17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.700914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f1289386aa42cfb6a11fd3fe74c3a3', 'request_id': 'req-be928461-e4f5-4d74-bc5d-fd707f34ae17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.707596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f1289386aa42cfb6a11fd3fe74c3a3', 'request_id': 'req-be928461-e4f5-4d74-bc5d-fd707f34ae17'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.718529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] The token cache is being invalidate because project f6f1289386aa42cfb6a11fd3fe74c3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:56.718749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.719365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.721646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1213/2433] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:56 2022] DELETE /identity/v3/projects/f6f1289386aa42cfb6a11fd3fe74c3a3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:56.725553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:56.734998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595209af-7917-452d-8a03-8884eecfe1b7 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:56.792954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:56.793579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:56.793853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:56.794122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] PATH_INFO: `/v3/users/f2c7e4a900c04f5195cdc71f8f34b90a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:56.795231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c7e4a900c04f5195cdc71f8f34b90a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:56.797152 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:56.842411 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c7e4a900c04f5195cdc71f8f34b90a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.850531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c7e4a900c04f5195cdc71f8f34b90a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.851287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c7e4a900c04f5195cdc71f8f34b90a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.851911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c7e4a900c04f5195cdc71f8f34b90a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.863690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8baf8391-e0f1-4ee8-8165-ed0301e9bb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c7e4a900c04f5195cdc71f8f34b90a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:56.879497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1221/2434] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:56 2022] DELETE /identity/v3/users/f2c7e4a900c04f5195cdc71f8f34b90a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:57.454133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:57.456066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:57.477347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be928461-e4f5-4d74-bc5d-fd707f34ae17 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:57.487327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:57.552335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:57.553009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.553293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.553558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] PATH_INFO: `/v3/projects/c9b2329cf59a4974b5835aedd7af1532` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.554701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b2329cf59a4974b5835aedd7af1532)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:57.556676 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:57.605806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b2329cf59a4974b5835aedd7af1532', 'request_id': 'req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:57.614925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b2329cf59a4974b5835aedd7af1532', 'request_id': 'req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:57.620901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b2329cf59a4974b5835aedd7af1532', 'request_id': 'req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:57.632221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] The token cache is being invalidate because project c9b2329cf59a4974b5835aedd7af1532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:11:57.632505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:57.633200 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d3f8b09-2aa6-40aa-8e32-bbcbff8ea135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:57.634664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1214/2435] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:11:57 2022] DELETE /identity/v3/projects/c9b2329cf59a4974b5835aedd7af1532 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:57.639448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.639957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.640050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.660389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:57.661686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:57.709682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:57.726129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1222/2436] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:57.734333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.734626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.734906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.755687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:57.756833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:57.765244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1215/2437] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:57.769790 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:57.780014 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672f1c-47e1-4cd5-9a1f-a937b0ee4ef7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:57.785531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:57.786155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.786440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.786707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.787354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:11:57.787716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:57.789241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:57.803493 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1223/2438] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:11:57.806607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:57.816402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bde8f-8f5f-4ed7-84a7-0ed66bfeaec3 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:57.821232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:57.821849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.822130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.822393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.823029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:57.824980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:57.854157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1216/2439] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:57 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:57.857990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:57.868609 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3d4ad-acf7-406d-9414-581014ee02ba admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:57.926322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:57.927780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.928079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.928348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.929193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:57.931111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:57.959128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1224/2440] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:57 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:57.963216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:57.974681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99af332-e1c2-4fb5-8cf8-0d8b50c959cf admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:57.981587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:57.982180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.982454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.982717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.983344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:57.984978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:57.996360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1217/2441] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:58.000673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.012051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb8a0d-1f5e-475d-b3ce-816a561b52ad admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.016844 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.017450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.017724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.018005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.018630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.020259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b2468-9dcb-4e04-b507-fb67bd2a5960 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.033487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1225/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:11:58.037999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.050542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a34b39-66da-450b-b24a-98488392132f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.056267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.057001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.057288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.057570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] PATH_INFO: `/v3/projects/2412a5d51c3642a2a0a057de8b3737c4/users/4f668f72ccdf4d04a04411b271272a7e/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.080575 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2412a5d51c3642a2a0a057de8b3737c4, user_id=4f668f72ccdf4d04a04411b271272a7e, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.083709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.106700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1218/2443] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:58 2022] PUT /identity/v3/projects/2412a5d51c3642a2a0a057de8b3737c4/users/4f668f72ccdf4d04a04411b271272a7e/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:58.119216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.119552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.119808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.155256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] MFA Rules not processed for user `4f668f72ccdf4d04a04411b271272a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:58.157142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:58.237138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1226/2444] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:58.242039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.285837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.309456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b3d56-39c1-473c-87ab-1aefd0340e53 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.314323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.314928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.315201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.315500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.316128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.318108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.347579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1219/2445] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:11:58 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:11:58.351487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.362594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71761215-c11e-454c-b735-c9fa34811f00 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.414022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.429196 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.429878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.430181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.430452 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.431191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.432992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.458694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1227/2446] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:11:58 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:11:58.459878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.471125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29ed5b-2f9a-476e-bdac-195c395825f0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.475824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.476408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.476683 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.476982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.477958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.479572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.490289 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1220/2447] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:58.494567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.505421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a101-80ed-4b61-83b2-945d52225c5b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.510691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.511626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.513122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.513437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] PATH_INFO: `/v3/projects/167a56bda3804a6e8c2c874d67be1116/users/f5a17d596a3d4d9caa5408330c5d1ae8/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.533667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a56bda3804a6e8c2c874d67be1116, user_id=f5a17d596a3d4d9caa5408330c5d1ae8, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.536287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.552785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1228/2448] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:58 2022] PUT /identity/v3/projects/167a56bda3804a6e8c2c874d67be1116/users/f5a17d596a3d4d9caa5408330c5d1ae8/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:58.556559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.573789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dee27-7ade-45d5-8716-4a57cd8b711a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.628502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.629152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.629418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.629682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.630313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.632863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302110ce-4d5a-4359-8df7-14f4b2088a21 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.646972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1221/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:11:58.648218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.659275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12fed-2491-4843-888e-b74634cb2458 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.668134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.668807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.669086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.669358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] PATH_INFO: `/v3/projects/167a56bda3804a6e8c2c874d67be1116/users/f5a17d596a3d4d9caa5408330c5d1ae8/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.671307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a56bda3804a6e8c2c874d67be1116, user_id=f5a17d596a3d4d9caa5408330c5d1ae8, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.674077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.685512 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1229/2450] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:11:58 2022] PUT /identity/v3/projects/167a56bda3804a6e8c2c874d67be1116/users/f5a17d596a3d4d9caa5408330c5d1ae8/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:58.754096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.754378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.754685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.787011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] MFA Rules not processed for user `f5a17d596a3d4d9caa5408330c5d1ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:58.788271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:58.862902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1222/2451] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:58.872543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.874241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:58.933222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdbcc8-cac4-424d-ae83-900129af9c98 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.936875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.937475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.937747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.938016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.949770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.951382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834d285-1bcb-45b2-83c1-cd4cee0e89cb service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.963805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1230/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:59.358149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:59.394790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:59.425076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee33c9-73d2-442c-b02a-47bc22fa3753 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:59.429883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:59.430512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:59.430785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:59.431052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] PATH_INFO: `/v3/users/4f668f72ccdf4d04a04411b271272a7e` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:59.432190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f668f72ccdf4d04a04411b271272a7e)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:59.434154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:59.485593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f668f72ccdf4d04a04411b271272a7e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:59.493527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f668f72ccdf4d04a04411b271272a7e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:59.494933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f668f72ccdf4d04a04411b271272a7e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:59.495661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f668f72ccdf4d04a04411b271272a7e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:59.503338 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f668f72ccdf4d04a04411b271272a7e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:11:59.521536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1223/2453] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:11:59 2022] DELETE /identity/v3/users/4f668f72ccdf4d04a04411b271272a7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:11:59.525961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:59.526245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:59.526519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:59.546575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:59.547738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:59.620835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1231/2454] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:59.627123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:59.628678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:59.692849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a450-3651-4507-83b2-69ece4d21156 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:59.696540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:59.697147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:59.697424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:59.697692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:59.708165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:59.709622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:59.720814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1224/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:59.733494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:59.734992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:59.790444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:59.826336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f002d-cd5f-44ac-9797-defdcf4230ef None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:59.832880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:59.833498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:59.833777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:59.834049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:59.836369 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:59.851348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:59.853311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:59.865065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1232/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:00.021097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:00.022608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:00.036428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9d7cb-52ae-4a0f-8ce7-9f9f2fc9ff21 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:00.041151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:00.041844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:00.042187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:00.043056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] PATH_INFO: `/v3/projects/2412a5d51c3642a2a0a057de8b3737c4` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:00.043692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2412a5d51c3642a2a0a057de8b3737c4)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:00.045971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:00.094304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2412a5d51c3642a2a0a057de8b3737c4', 'request_id': 'req-2e038623-4f64-4499-bacd-8484a15e2716'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.096025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:00.103034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2412a5d51c3642a2a0a057de8b3737c4', 'request_id': 'req-2e038623-4f64-4499-bacd-8484a15e2716'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.109633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2412a5d51c3642a2a0a057de8b3737c4', 'request_id': 'req-2e038623-4f64-4499-bacd-8484a15e2716'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.120830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] The token cache is being invalidate because project 2412a5d51c3642a2a0a057de8b3737c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:00.121115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.121786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.123331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1225/2457] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:00 2022] DELETE /identity/v3/projects/2412a5d51c3642a2a0a057de8b3737c4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:00.128371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:00.138852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7671e9d-3526-4823-a0b1-91522558e5bb service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:00.197234 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:00.197653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:00.197763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:00.197950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] PATH_INFO: `/v3/users/f5a17d596a3d4d9caa5408330c5d1ae8` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:00.199099 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a17d596a3d4d9caa5408330c5d1ae8)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:00.201065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:00.249933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a17d596a3d4d9caa5408330c5d1ae8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.259881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a17d596a3d4d9caa5408330c5d1ae8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.260505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a17d596a3d4d9caa5408330c5d1ae8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.261161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a17d596a3d4d9caa5408330c5d1ae8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.275664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fd48d642-6e68-4f6f-b7a3-8c59e9b80df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a17d596a3d4d9caa5408330c5d1ae8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.289808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1233/2458] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:00 2022] DELETE /identity/v3/users/f5a17d596a3d4d9caa5408330c5d1ae8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:00.686490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:00.688556 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:00.703240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e038623-4f64-4499-bacd-8484a15e2716 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:00.766737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:00.767871 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:00.768094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:00.768377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] PATH_INFO: `/v3/projects/167a56bda3804a6e8c2c874d67be1116` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:00.769525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167a56bda3804a6e8c2c874d67be1116)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:00.771443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:00.822198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167a56bda3804a6e8c2c874d67be1116', 'request_id': 'req-37f6292b-9317-460b-9d13-dd51ce950e65'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.830478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167a56bda3804a6e8c2c874d67be1116', 'request_id': 'req-37f6292b-9317-460b-9d13-dd51ce950e65'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.837994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167a56bda3804a6e8c2c874d67be1116', 'request_id': 'req-37f6292b-9317-460b-9d13-dd51ce950e65'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.852066 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] The token cache is being invalidate because project 167a56bda3804a6e8c2c874d67be1116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:00.852458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.853279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-37f6292b-9317-460b-9d13-dd51ce950e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:00.855534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1226/2459] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:00 2022] DELETE /identity/v3/projects/167a56bda3804a6e8c2c874d67be1116 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:00.860421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:00.861591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:00.861690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:00.882923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:00.884120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:00.931229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:00.952412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1234/2460] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:00.960620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:00.960903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:00.961174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:00.983732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:00.984979 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:00.994376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1227/2461] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:00.998600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.009186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94c667-53d8-4204-8767-7cea6cc1956d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.014511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.015292 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.015868 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.016340 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.017745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:12:01.018343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.020528 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.034843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1235/2462] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:12:01.039177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.048833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccde08a-e994-4a38-81a3-b2caff67f565 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.053787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.054381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.054659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.054937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.055599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.057520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.095784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1228/2463] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:01.100079 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.110984 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9ad0-0feb-4c0e-a29d-85d7ea939707 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.214304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.215094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.215371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.216533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.217274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.219539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.252559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1236/2464] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:01 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:01.256614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.268932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014237d-2e98-4b76-9a0a-ea016fb2bf6d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.274808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.275659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.276084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.277113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.278022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.280025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.294479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1229/2465] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:12:01.298498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.310264 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d351-5534-4b4e-9354-7bd5d43c6a18 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.315723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.316631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.316917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.317183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.317827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.319393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aac28a-3c1c-49bd-9c66-a453b62ac8b2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.331985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1237/2466] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:01.335937 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.347158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271274-5fe8-4114-a2c2-640259d164b8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.352668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.353486 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.353754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.354032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] PATH_INFO: `/v3/projects/83faa413da044ec88274ea88914f8c20/users/9aa7b63ce23c41d684cdefc404b0fffb/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.371287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83faa413da044ec88274ea88914f8c20, user_id=9aa7b63ce23c41d684cdefc404b0fffb, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.373406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.394118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1230/2467] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:01 2022] PUT /identity/v3/projects/83faa413da044ec88274ea88914f8c20/users/9aa7b63ce23c41d684cdefc404b0fffb/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:01.399078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.399430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.399730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.430117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] MFA Rules not processed for user `9aa7b63ce23c41d684cdefc404b0fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:01.431258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.507271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1238/2468] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:01.521267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.523726 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.533507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:01.591770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075cc4-1f47-4168-adce-6f0baf3568c1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.595801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.596400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.596673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.596939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.605929 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.607450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20e420-364b-413e-a6c2-014825e50330 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.617760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1231/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:01.639906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.698074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:01.728347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59912688-70a6-4c04-9a1a-eac5638076d0 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.733212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.733990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.734271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.734546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] PATH_INFO: `/v3/users/9aa7b63ce23c41d684cdefc404b0fffb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.736394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa7b63ce23c41d684cdefc404b0fffb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.738983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.807654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa7b63ce23c41d684cdefc404b0fffb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:01.817378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa7b63ce23c41d684cdefc404b0fffb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:01.818226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa7b63ce23c41d684cdefc404b0fffb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:01.818909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa7b63ce23c41d684cdefc404b0fffb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:01.833203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa7b63ce23c41d684cdefc404b0fffb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:01.859560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1239/2470] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:01 2022] DELETE /identity/v3/users/9aa7b63ce23c41d684cdefc404b0fffb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:01.862976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.863436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.863667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.887270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:01.888529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.957405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1232/2471] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:01.966994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.968453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:02.032112 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e00919-b99c-4473-aaa7-c587f6143e44 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.036245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.036849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.037122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.037386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.046437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:02.047883 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1456902-8ead-41d0-85e6-55df74365bbe service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:02.058387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1240/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:02.433400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:02.435533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:02.456761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f69ae-afff-4a38-9cb1-1d469d7ca539 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.461535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.462249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.462540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.463355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] PATH_INFO: `/v3/projects/83faa413da044ec88274ea88914f8c20` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.470851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83faa413da044ec88274ea88914f8c20)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:02.474906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:02.549043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83faa413da044ec88274ea88914f8c20', 'request_id': 'req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:02.557053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83faa413da044ec88274ea88914f8c20', 'request_id': 'req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:02.563125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83faa413da044ec88274ea88914f8c20', 'request_id': 'req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:02.574522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] The token cache is being invalidate because project 83faa413da044ec88274ea88914f8c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:02.574805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:02.575447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e6525e21-df35-4e0a-9d9f-7bcb08ff08f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:02.577020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1233/2473] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:02 2022] DELETE /identity/v3/projects/83faa413da044ec88274ea88914f8c20 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:02.584797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.585103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.585569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.617363 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:02.619085 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:02.702317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1241/2474] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:02.710738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.711015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.711282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.733013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:02.734142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:02.741964 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1234/2475] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:02.746413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:02.752597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:02.756801 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaae174-c263-44bb-95a5-140c42f499ea None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.763737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.764554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.764993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.765443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.766226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:12:02.766592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:02.768859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:02.783570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1242/2476] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:12:02.788038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:02.798581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aaad1-351d-42d3-a237-59eb7a65196c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.803865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.804619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.804998 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.805275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.805916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:02.808037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:02.837908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1235/2477] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:02 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:02.842151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:02.853023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80619be6-ca95-49d8-8c01-c3a370a772a0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.941137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.941752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.942027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.942296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:02.942936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:02.945139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:02.972820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1243/2478] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:02 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:02.976813 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:02.982635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:02.990168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80298da-d7f4-4f40-920d-0d7e57f565f5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:02.997606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:02.998513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:02.998839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:02.999605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.000443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.002892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.014869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1236/2479] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:03.020460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.031058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083872a5-14f7-43cf-9537-1cb65530bbb9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.036358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.037047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.037392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.037732 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.038442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.044553 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdedde9-d8d0-4c43-8406-4aa31c106e53 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.057716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:03.061824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.073067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4943c3-2606-4802-ba71-89d9ddce9fec admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.079444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.080680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.081018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.081290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] PATH_INFO: `/v3/projects/d954b357fa4b4117a9a9ae769c441d25/users/a21b2fe64f084e038947e236e7d2721c/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.098346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d954b357fa4b4117a9a9ae769c441d25, user_id=a21b2fe64f084e038947e236e7d2721c, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.101074 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.118861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1237/2481] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:03 2022] PUT /identity/v3/projects/d954b357fa4b4117a9a9ae769c441d25/users/a21b2fe64f084e038947e236e7d2721c/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:12:03.131294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.132289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.132568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.175129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] MFA Rules not processed for user `a21b2fe64f084e038947e236e7d2721c`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:03.176428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:03.310889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.311640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1245/2482] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:03.444547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22540b93-d008-46bf-9fd1-f5cc2373affd admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.449550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.450305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.450685 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.451058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.451830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.454105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.490710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1238/2483] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:03 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:03.495192 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.508122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf2747-11fe-4064-b8c2-161508a46d8d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.577655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.578268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.578551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.578825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.579564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.582062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.591541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:03.607874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1246/2484] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:03 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:03.612357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.623341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2d8da-e77b-48bf-9f2f-8d67a92f670c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.629163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.629774 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.630051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.630318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.630953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.632603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.645123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1239/2485] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:03.649170 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.660298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756f77-cf92-47b2-b060-803919af006d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.665393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.666060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.666342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.666619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] PATH_INFO: `/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01/users/c7a89d0aaa284da49632fb931282a826/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.685331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f52210e4d4bd1a4cda5003b87fd01, user_id=c7a89d0aaa284da49632fb931282a826, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.688120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.707494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1247/2486] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:03 2022] PUT /identity/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01/users/c7a89d0aaa284da49632fb931282a826/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:12:03.711453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.722585 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c95d-f9be-4734-ab99-6f51e7f35559 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.792353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.793022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.793302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.793597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.794254 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.796630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec37fe-56ab-47f3-9d2a-98afc54c0db2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.811940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1240/2487] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:03.817610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:03.834293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828232b-2f67-4fca-9f5d-74872d28cce3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:03.843349 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:03.844435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.844435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.844646 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] PATH_INFO: `/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01/users/c7a89d0aaa284da49632fb931282a826/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.848413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f52210e4d4bd1a4cda5003b87fd01, user_id=c7a89d0aaa284da49632fb931282a826, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:03.852156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:03.868174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1248/2488] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:03 2022] PUT /identity/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01/users/c7a89d0aaa284da49632fb931282a826/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:03.881708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe351f-4ef1-4b9e-bb2d-394b02ddff59 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:03.882111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe351f-4ef1-4b9e-bb2d-394b02ddff59 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:03.882519 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe351f-4ef1-4b9e-bb2d-394b02ddff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:03.922508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e7fe351f-4ef1-4b9e-bb2d-394b02ddff59 None None] MFA Rules not processed for user `c7a89d0aaa284da49632fb931282a826`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:03.924036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e7fe351f-4ef1-4b9e-bb2d-394b02ddff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:03.958778 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:04.043421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1241/2489] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:04.054874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:04.056667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:04.117913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b62dd-1b54-4e77-a824-b21665d36756 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:04.121614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:04.122225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:04.122501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:04.122769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:04.190402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:04.191887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:04.203867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1249/2490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:12:04.766186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:04.766488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:04.767368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:04.791844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:04.793357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:04.859543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1242/2491] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:04.873684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:04.875541 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:04.972102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b6803-053c-4625-a13d-102602889ad2 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:04.977621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:04.978103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:04.978379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:04.978640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:04.987258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:04.991209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:04.994850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5e00-e95a-4955-bb09-998c98155c8e service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:05.004368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1250/2492] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:12:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:12:07.152710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:07.253214 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b58a51-71e8-4f7b-9822-a0599c37455f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:07.258718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:07.259435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:07.259831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:07.260316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] PATH_INFO: `/v3/users/a21b2fe64f084e038947e236e7d2721c` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:07.261407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21b2fe64f084e038947e236e7d2721c)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:07.263729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:07.327007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21b2fe64f084e038947e236e7d2721c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:07.336949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21b2fe64f084e038947e236e7d2721c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:07.337592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21b2fe64f084e038947e236e7d2721c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:07.340458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21b2fe64f084e038947e236e7d2721c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:07.357132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21b2fe64f084e038947e236e7d2721c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:07.363829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:07.385321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1243/2493] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:07 2022] DELETE /identity/v3/users/a21b2fe64f084e038947e236e7d2721c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:07.391372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:07.392018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:07.392209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:07.414147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:07.415484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:07.527154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1251/2494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:07.541165 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:07.542847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:07.635232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151847b3-f452-4512-b0d9-9dcc4adc519f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:07.647646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:07.648941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:07.649537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:07.650160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:07.664593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:07.667099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:07.683038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1244/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:08.121177 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:08.125086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:08.182364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c24de-d196-4d20-aeef-06f14cbd948d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:08.197886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:08.199294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:08.199823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:08.200293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] PATH_INFO: `/v3/projects/d954b357fa4b4117a9a9ae769c441d25` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:08.207785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d954b357fa4b4117a9a9ae769c441d25)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:08.212873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:08.321492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd954b357fa4b4117a9a9ae769c441d25', 'request_id': 'req-4634920b-3ac2-4fbb-a27d-a482b255456d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.342929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd954b357fa4b4117a9a9ae769c441d25', 'request_id': 'req-4634920b-3ac2-4fbb-a27d-a482b255456d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.364015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd954b357fa4b4117a9a9ae769c441d25', 'request_id': 'req-4634920b-3ac2-4fbb-a27d-a482b255456d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.395904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] The token cache is being invalidate because project d954b357fa4b4117a9a9ae769c441d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:08.396455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.396983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.398762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1252/2496] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:08 2022] DELETE /identity/v3/projects/d954b357fa4b4117a9a9ae769c441d25 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:08.404906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:08.420326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b4176-0be6-4960-be85-89b1c75003cb service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:08.681522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:08.682119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:08.682398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:08.682669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] PATH_INFO: `/v3/users/c7a89d0aaa284da49632fb931282a826` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:08.683954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a89d0aaa284da49632fb931282a826)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:08.686162 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:08.774195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a89d0aaa284da49632fb931282a826'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.781312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a89d0aaa284da49632fb931282a826'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.782049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a89d0aaa284da49632fb931282a826'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.782697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a89d0aaa284da49632fb931282a826'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.789940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6f1c41ef-33ce-4e81-b0bc-5b36473068e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a89d0aaa284da49632fb931282a826'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:08.809393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1245/2497] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:08 2022] DELETE /identity/v3/users/c7a89d0aaa284da49632fb931282a826 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:09.169095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.170807 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.197967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634920b-3ac2-4fbb-a27d-a482b255456d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.321507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.322556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.322909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.323408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] PATH_INFO: `/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.325255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51f52210e4d4bd1a4cda5003b87fd01)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.327409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.362028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:09.396971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51f52210e4d4bd1a4cda5003b87fd01', 'request_id': 'req-0620b1d1-42b1-422d-b1a8-b6173927b8a3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:09.405885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51f52210e4d4bd1a4cda5003b87fd01', 'request_id': 'req-0620b1d1-42b1-422d-b1a8-b6173927b8a3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:09.413204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51f52210e4d4bd1a4cda5003b87fd01', 'request_id': 'req-0620b1d1-42b1-422d-b1a8-b6173927b8a3'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:09.427996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] The token cache is being invalidate because project e51f52210e4d4bd1a4cda5003b87fd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:09.428286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:09.428966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-0620b1d1-42b1-422d-b1a8-b6173927b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:09.431094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1253/2498] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:09 2022] DELETE /identity/v3/projects/e51f52210e4d4bd1a4cda5003b87fd01 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:09.435865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.436792 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.437263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.465558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:09.466794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.472062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:09.549798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1246/2499] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:09.557743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.558027 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.558302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.582730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:09.584007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.592987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1254/2500] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:09.597794 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.611281 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80737c-8ca6-4f89-b283-639d767d5d4a None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.616643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.617305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.617577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.618061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.618770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:12:09.619129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.620878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.642616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:12:09.647595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.661678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be7311-d2c0-4cb3-8c04-855de8f69e7d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.670580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.671244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.672057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.672057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.672556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.674694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.707523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1255/2502] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:09.711419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.724016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c37977-b0f2-445d-ab9b-9a5c89a2bc8d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.799858 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.800479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.800754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.801980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.802749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.804811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.834541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1248/2503] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:09.838521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.851182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc1a57-91a8-45d1-b04a-46b45fe3376e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.856086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.856694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.856968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.857238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.857893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.859442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.871955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1256/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:09.875872 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.886635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dce405-6d22-4dea-85b9-4f14b14a8ad7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.892789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.893427 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.893758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.894012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.894842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.896535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53c706-58b1-405d-ac2a-9d4c24b2c279 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.911522 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1249/2505] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:09.914272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.925737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537082f-e07f-4bcb-8ce3-6820058f51ea admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.931285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.932316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.932768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.933220 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] PATH_INFO: `/v3/projects/28f7d9aba9f740e787fee7e51fec1dd1/users/a4f2c7dc3a32463787683ca48b941177/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.956044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f7d9aba9f740e787fee7e51fec1dd1, user_id=a4f2c7dc3a32463787683ca48b941177, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.960436 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.976804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1257/2506] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:09 2022] PUT /identity/v3/projects/28f7d9aba9f740e787fee7e51fec1dd1/users/a4f2c7dc3a32463787683ca48b941177/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:12:09.990239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.990574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.990808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:10.031233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] MFA Rules not processed for user `a4f2c7dc3a32463787683ca48b941177`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:10.033548 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:10.108374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1250/2507] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:10.121139 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:10.122886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:10.192257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679988-3b7f-4aa1-870d-032764516cd0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:10.196212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:10.196856 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:10.197133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:10.197419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:10.208470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:10.209922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:10.220377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1258/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:10.450744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:10.452462 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:10.459740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:10.564417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677887-3c62-424a-93ad-b917da4e88d4 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:10.569699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:10.570536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:10.571180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:10.571495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:10.574280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:10.664307 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:10.665613 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:10.677513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1251/2509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:14.777290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:14.779379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.856855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:14.904673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b581937-8324-4d21-95e2-cdc47680b18e service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:14.915982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:14.917409 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:14.917571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.918318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:14.918698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:14.919074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:14.921164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.938238 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:14.939201 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bab9-f91c-4cd5-a72c-d146f4122cc4 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:14.941021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:14.955763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:14.957354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:14.957354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:14.957354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] PATH_INFO: `/v3/users/809fcd4bc90440539af13ea0d1c8cb0b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:14.960921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=809fcd4bc90440539af13ea0d1c8cb0b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:14.964750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:14.965350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1259/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:15.049586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809fcd4bc90440539af13ea0d1c8cb0b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.060408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809fcd4bc90440539af13ea0d1c8cb0b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.061185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809fcd4bc90440539af13ea0d1c8cb0b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.061955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809fcd4bc90440539af13ea0d1c8cb0b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.075800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-dd7a7cc5-f537-4369-8115-d60e5516eafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809fcd4bc90440539af13ea0d1c8cb0b'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.101878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1252/2511] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:14 2022] DELETE /identity/v3/users/809fcd4bc90440539af13ea0d1c8cb0b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:15.316319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:15.330371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689be22-027e-4341-97bd-dc3a49afca7d service placement] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:15.415582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:15.416610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.416966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.417307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] PATH_INFO: `/v3/projects/6feeabc46f0a43728e2de195961f82b1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.418611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6feeabc46f0a43728e2de195961f82b1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:15.420594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:15.503996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6feeabc46f0a43728e2de195961f82b1', 'request_id': 'req-10926d64-31fa-4527-bfdb-a9e87791aab6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.503996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6feeabc46f0a43728e2de195961f82b1', 'request_id': 'req-10926d64-31fa-4527-bfdb-a9e87791aab6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.509884 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6feeabc46f0a43728e2de195961f82b1', 'request_id': 'req-10926d64-31fa-4527-bfdb-a9e87791aab6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.533863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] The token cache is being invalidate because project 6feeabc46f0a43728e2de195961f82b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:15.534441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.537063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-10926d64-31fa-4527-bfdb-a9e87791aab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:15.539290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1260/2512] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:15 2022] DELETE /identity/v3/projects/6feeabc46f0a43728e2de195961f82b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:15.544211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.544603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.545055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.580721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:15.584546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:15.617431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:15.691098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1253/2513] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:15.698696 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.698983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.699259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.725104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:15.726338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:15.740877 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1261/2514] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:15.745876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:15.756567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fd1a-70ab-4459-af40-d9e33fd8d614 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:15.761326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:15.761932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.762210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.762544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.763293 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:12:15.763632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:15.765247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:15.782875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1254/2515] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:12:15.784762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:15.795814 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232fd2-fe28-49b5-8a9f-334cee09c940 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:15.801784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:15.802387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.802663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.802929 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.803597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:15.805545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:15.869239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1262/2516] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:15 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:15.871715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:15.884633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24162-f33c-4744-b153-be2d932ff43d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:15.976528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:15.977178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:15.977431 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:15.977827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:15.978501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:15.980639 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.011850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1255/2517] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:15 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:12:16.016074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.037995 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f0eb-3613-4dbd-bfd3-087694362fa4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.046397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.047181 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.047871 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.048118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.050335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.052697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.072607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1263/2518] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:12:16.076912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.091827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c308a0-f75a-461d-8636-a03772251523 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.100977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.101698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.102049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.102388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.103123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.105030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe4e5-061c-4072-904b-614d3dadb5a9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.136686 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.148855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1256/2519] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:16.155962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686aa0a-b56d-4a55-8f16-1d1c3fde02e3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.181741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.181741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.181741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.181741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] PATH_INFO: `/v3/projects/03953c3189784739be7fc400a1fdf30d/users/84856d83cab14e7ea6255d1ff0bd633a/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.224555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03953c3189784739be7fc400a1fdf30d, user_id=84856d83cab14e7ea6255d1ff0bd633a, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.229916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.293469 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1264/2520] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:16 2022] PUT /identity/v3/projects/03953c3189784739be7fc400a1fdf30d/users/84856d83cab14e7ea6255d1ff0bd633a/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:16.312983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.313442 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.313905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.370436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] MFA Rules not processed for user `84856d83cab14e7ea6255d1ff0bd633a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:16.371790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:16.461572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.466819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1257/2521] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:16.470674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:16.562967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6894-1c39-47e8-b7f0-6dafb8f3b27f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.572392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.573754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.574228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.574724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.575958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.578300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.617806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1265/2522] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:16 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:12:16.621366 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.649160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e8dd3-6468-45bb-84f4-c8612e22784b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.688273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:16.737421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.738202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.738627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.738949 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.739724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.741742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.775834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1258/2523] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:16 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:16.777638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.790834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1de1a-d3d9-42c9-989f-75d519e7ebc0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.796339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.797116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.797550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.798647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.799670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.801862 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.816232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1266/2524] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:12:16.820963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.837280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdddb8-540f-4d65-b93a-86f5c00d9a1f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:16.843013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:16.843933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:16.844284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:16.845046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] PATH_INFO: `/v3/projects/28713eaf116e4e07b4327d52a812d8f2/users/ebf155142a1d45a196241a61d5a51960/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:16.865235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28713eaf116e4e07b4327d52a812d8f2, user_id=ebf155142a1d45a196241a61d5a51960, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:16.867967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:16.895688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1259/2525] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:16 2022] PUT /identity/v3/projects/28713eaf116e4e07b4327d52a812d8f2/users/ebf155142a1d45a196241a61d5a51960/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:16.900490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:16.912508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5fcd1-e73e-4cdc-b8ec-cb18fac49bb2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:17.015726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:17.016253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.016556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.016847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.017475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:17.019052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb31d53-0916-4ad3-827f-701afdd3319b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:17.035505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1267/2526] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:17.037454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:17.055418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c6651-9de4-44c4-ba70-d0c1717f52a7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:17.072001 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:17.072952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.073340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.073626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] PATH_INFO: `/v3/projects/28713eaf116e4e07b4327d52a812d8f2/users/ebf155142a1d45a196241a61d5a51960/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.075762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28713eaf116e4e07b4327d52a812d8f2, user_id=ebf155142a1d45a196241a61d5a51960, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:17.078393 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:17.091533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1260/2527] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:17 2022] PUT /identity/v3/projects/28713eaf116e4e07b4327d52a812d8f2/users/ebf155142a1d45a196241a61d5a51960/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:17.102744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.103024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.103297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.140082 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] MFA Rules not processed for user `ebf155142a1d45a196241a61d5a51960`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:17.150296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:17.239114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:17.244067 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:17.267103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:17.269049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:17.338310 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917452a-7902-4a46-a665-d3da3eb62087 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:17.343494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:17.344487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.345466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.346003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.358502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:17.361007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:17.389279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1261/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:17.529058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:17.541180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28886-932d-4abc-ae00-763e243e2224 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:17.545946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:17.546575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.547056 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.547343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.609669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:17.611404 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46130661-2ae2-4dc3-bebd-e25f2ad5509a service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:17.621544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1269/2530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:20.228077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:20.289687 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16aa1-6ab1-41c8-9385-3d7d12140231 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:20.294161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:20.294772 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.295048 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.295316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] PATH_INFO: `/v3/users/84856d83cab14e7ea6255d1ff0bd633a` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.296459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84856d83cab14e7ea6255d1ff0bd633a)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:20.299169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:20.320995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:20.347659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84856d83cab14e7ea6255d1ff0bd633a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.355734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84856d83cab14e7ea6255d1ff0bd633a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.356412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84856d83cab14e7ea6255d1ff0bd633a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.357053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84856d83cab14e7ea6255d1ff0bd633a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.365014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84856d83cab14e7ea6255d1ff0bd633a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.382266 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1262/2531] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:20 2022] DELETE /identity/v3/users/84856d83cab14e7ea6255d1ff0bd633a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:20.386903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.387386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.387518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.406371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:20.408242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:20.473746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1270/2532] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:20.483396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:20.484940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:20.548122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682564b-08cb-40fc-b32a-f20b1701fc3b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:20.552047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:20.553265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.553900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.554171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.564593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:20.566022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:20.577140 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1263/2533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:20.866357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:20.873402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:20.888147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3358-777f-4b7c-8df6-b22dd7f094e6 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:20.896466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:20.897028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.897308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.897591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] PATH_INFO: `/v3/projects/03953c3189784739be7fc400a1fdf30d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.898806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03953c3189784739be7fc400a1fdf30d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:20.900818 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:20.953019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03953c3189784739be7fc400a1fdf30d', 'request_id': 'req-fcc236e5-564a-46e7-84ea-5462c5d122dd'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.961110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03953c3189784739be7fc400a1fdf30d', 'request_id': 'req-fcc236e5-564a-46e7-84ea-5462c5d122dd'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.966843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03953c3189784739be7fc400a1fdf30d', 'request_id': 'req-fcc236e5-564a-46e7-84ea-5462c5d122dd'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.979249 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] The token cache is being invalidate because project 03953c3189784739be7fc400a1fdf30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:20.979446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.980235 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:20.982147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1271/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:20 2022] DELETE /identity/v3/projects/03953c3189784739be7fc400a1fdf30d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:20.986820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.000622 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0455-3b67-4370-a770-8fc9b745b129 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.059982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.060614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.060888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.061208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] PATH_INFO: `/v3/users/ebf155142a1d45a196241a61d5a51960` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.062342 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf155142a1d45a196241a61d5a51960)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.064869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.109668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:21.115878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf155142a1d45a196241a61d5a51960'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.125602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf155142a1d45a196241a61d5a51960'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.127101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf155142a1d45a196241a61d5a51960'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.127934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf155142a1d45a196241a61d5a51960'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.136597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1ace8646-59b4-4215-b7d2-9b97751e678b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf155142a1d45a196241a61d5a51960'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.154504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1264/2535] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:20 2022] DELETE /identity/v3/users/ebf155142a1d45a196241a61d5a51960 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:12:21.484544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.487956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.504355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc236e5-564a-46e7-84ea-5462c5d122dd admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.539024 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:21.591709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.591709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.591709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.591709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] PATH_INFO: `/v3/projects/28713eaf116e4e07b4327d52a812d8f2` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.592073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28713eaf116e4e07b4327d52a812d8f2)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.592073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.649222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28713eaf116e4e07b4327d52a812d8f2', 'request_id': 'req-c43e80d6-00b0-4dd1-abe3-8116b5555a52'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.656155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28713eaf116e4e07b4327d52a812d8f2', 'request_id': 'req-c43e80d6-00b0-4dd1-abe3-8116b5555a52'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.662069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28713eaf116e4e07b4327d52a812d8f2', 'request_id': 'req-c43e80d6-00b0-4dd1-abe3-8116b5555a52'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.674610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] The token cache is being invalidate because project 28713eaf116e4e07b4327d52a812d8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:21.674912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.675587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c43e80d6-00b0-4dd1-abe3-8116b5555a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.677727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1272/2536] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:21 2022] DELETE /identity/v3/projects/28713eaf116e4e07b4327d52a812d8f2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:21.682287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.682786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.682898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.710174 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:21.711489 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.778988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1265/2537] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:21.788546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.789088 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.789510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.796503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.798450 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.813331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1468e-3b61-4a23-b24d-6e3faff5569c None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.820438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.821445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.821673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.822176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] PATH_INFO: `/v3/users/a4f2c7dc3a32463787683ca48b941177` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.823802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f2c7dc3a32463787683ca48b941177)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.825822 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.830583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:21.832100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.841473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1273/2538] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:21.847015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.857351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701be86-a358-4e19-974b-d8812d3a6fdf None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.864422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.865098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.865378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.865645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.866442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:12:21.866745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.868360 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.887063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1274/2539] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:12:21.888124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.894773 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f2c7dc3a32463787683ca48b941177'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.899378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded7663-0952-46de-8f7d-174593d4515c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.904941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.905734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.906018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.906290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.906927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.909819 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.920203 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f2c7dc3a32463787683ca48b941177'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.921724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f2c7dc3a32463787683ca48b941177'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.923600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f2c7dc3a32463787683ca48b941177'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.941014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-374dce18-5a56-4073-b2e0-b2bea94b46ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f2c7dc3a32463787683ca48b941177'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:21.953017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1275/2540] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:21 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:21.957722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.960906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.977593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1266/2541] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:21 2022] DELETE /identity/v3/users/a4f2c7dc3a32463787683ca48b941177 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:21.982016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.982311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.982669 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.013219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:22.014440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:22.043243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b08af-2574-4002-8fce-47d561907cfe admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.045340 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:22.058167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:22.089898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1267/2542] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:22.099750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.101103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:22.117913 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.118619 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.118966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.119310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.120049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.122030 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.147366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1276/2543] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:21 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:12:22.151414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.162484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cd1bf-29dd-47db-8a3e-591d7281656e admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.168090 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.168561 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.168833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.169218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.169861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.171641 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.173644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565176-1938-4863-b38f-4aa5e30946e4 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.177791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.178400 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.178682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.178947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.185052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1277/2544] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:12:22.189837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.192689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.194167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.201921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292cd7-8626-49a4-9cf6-a7807a9a5914 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.205087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1268/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:22.207491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.209204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.209481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.210161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.210572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.212467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9ead-cf8f-43db-9cb3-9a03439688df admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.226289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1278/2546] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:12:22.230821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.245078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d06ce-0580-4671-a7f6-b2feb60d0df3 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.252824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.253499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.254169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.254169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] PATH_INFO: `/v3/projects/a7402fe2f2584c92b06f1a871a4b4330/users/b40c0fdee48745218654bbad8bac81a9/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.274451 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7402fe2f2584c92b06f1a871a4b4330, user_id=b40c0fdee48745218654bbad8bac81a9, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.280483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.317270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1269/2547] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:22 2022] PUT /identity/v3/projects/a7402fe2f2584c92b06f1a871a4b4330/users/b40c0fdee48745218654bbad8bac81a9/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:22.323048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.323506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.324063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.358823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:22.360055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:22.436902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1279/2548] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:22.458218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.461251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:22.540037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d3ce1-cc17-4192-a41d-e758ea59ba55 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.544243 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.545063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.545350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.545785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.557473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.559003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669451c-eac1-4881-a7af-6b6145a8f11c service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.570370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1270/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:22.641506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:22.644135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:22.676172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784e64-5cb5-44f9-98fd-cc5c54872f85 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:22.686053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:22.686791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:22.687084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:22.687418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] PATH_INFO: `/v3/projects/28f7d9aba9f740e787fee7e51fec1dd1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:22.689430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f7d9aba9f740e787fee7e51fec1dd1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:22.692137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:22.755451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f7d9aba9f740e787fee7e51fec1dd1', 'request_id': 'req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:22.774480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f7d9aba9f740e787fee7e51fec1dd1', 'request_id': 'req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:22.783914 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f7d9aba9f740e787fee7e51fec1dd1', 'request_id': 'req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:22.802379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] The token cache is being invalidate because project 28f7d9aba9f740e787fee7e51fec1dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:12:22.802714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:22.804526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:22.807867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1280/2550] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:22 2022] DELETE /identity/v3/projects/28f7d9aba9f740e787fee7e51fec1dd1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:23.670403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:23.671235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:23.671710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:23.707808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] MFA Rules not processed for user `b40c0fdee48745218654bbad8bac81a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:23.708981 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:23.758377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:23.787376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1271/2551] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:23.791965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:23.793911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:23.806826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:23.871279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f9466-39e0-44ed-b228-bf3df7bf1e6a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:23.877540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:23.879145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:23.879145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:23.879145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:23.879445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:23.881278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:23.912453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1281/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:12:23 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:12:23.916745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:23.928408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f678e3-3b7e-4826-b160-dc8acb18dbde None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:23.989351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:23.989963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:23.990239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:23.991067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:23.991570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:23.993481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.017138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1272/2553] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:12:23 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:12:24.021393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.031846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3ed59-e09e-4e09-85fc-51179400cb2b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.038664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.039275 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.039584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.039855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.040494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.042072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.053464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1282/2554] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:24.057499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.067887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7726b56-26f5-4352-9140-5d33e5f0038a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.072597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.073326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.073608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.073882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] PATH_INFO: `/v3/projects/cda60240da374196b3413a0b514d9256/users/9410f2d320d549a4b9fb3cca685823ae/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.091015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda60240da374196b3413a0b514d9256, user_id=9410f2d320d549a4b9fb3cca685823ae, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.093696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.107971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1273/2555] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:24 2022] PUT /identity/v3/projects/cda60240da374196b3413a0b514d9256/users/9410f2d320d549a4b9fb3cca685823ae/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:24.112631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.123358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45bb6c-62d3-4b36-9476-d5eb78bdd353 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.186389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.187091 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.187441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.187797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.188444 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.190017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1989c40-6dd9-45bb-9094-ca497021dc10 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.199942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1283/2556] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:12:24.204751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.214970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64fe96-f347-4f44-b5bf-05cc4ee796c6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.219470 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.220809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.221087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.221354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] PATH_INFO: `/v3/projects/cda60240da374196b3413a0b514d9256/users/9410f2d320d549a4b9fb3cca685823ae/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.223299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda60240da374196b3413a0b514d9256, user_id=9410f2d320d549a4b9fb3cca685823ae, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.226248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.237202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1274/2557] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:12:24 2022] PUT /identity/v3/projects/cda60240da374196b3413a0b514d9256/users/9410f2d320d549a4b9fb3cca685823ae/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:24.440195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0781c-7501-4c60-95aa-eb9a6879ee24 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.440482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0781c-7501-4c60-95aa-eb9a6879ee24 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.440760 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0781c-7501-4c60-95aa-eb9a6879ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.462518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-75d0781c-7501-4c60-95aa-eb9a6879ee24 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:24.463752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-75d0781c-7501-4c60-95aa-eb9a6879ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:24.527505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1284/2558] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:24.541445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:24.543597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:24.625410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715b97-3f02-4004-9481-cfc61391a2a9 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:24.631347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:24.632143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:24.632308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:24.632649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:24.643173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:24.644915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab41a4f-adb8-4c85-9195-7d9d011686db service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:24.658609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1275/2559] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:25.036955 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:25.037506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:25.038034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:25.074502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] MFA Rules not processed for user `9410f2d320d549a4b9fb3cca685823ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:25.076253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:25.098054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:25.220689 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1285/2560] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:25.234102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:25.234670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:25.235891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:25.260422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] MFA Rules not processed for user `b40c0fdee48745218654bbad8bac81a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:25.261795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:25.283832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:25.329920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1276/2561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:25.342208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:25.343860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:25.437515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceaa4b-8992-49b8-a930-4eb4e05441c9 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:25.447043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:25.448066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:25.448351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:25.448701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:25.460154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:25.461939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ba58-5ac8-4ca0-b7ca-3546c804173b service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:25.477129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1286/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:25.757843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:25.759487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:25.822180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce32cc-d623-4e4a-bce8-698b87d26d1f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:25.824927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:25.825590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:25.825817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:25.826142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:25.827861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:25.839285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:25.840800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:25.866399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1277/2563] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:35.468314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=57 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:35.846647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=40 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:39.462903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:39.463417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:39.463595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:39.484022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:39.485888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:39.493244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1287/2564] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:39.515292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:39.527863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3728c8-5147-4501-b442-3c8d01b3f000 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:39.533202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:39.533799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:39.534705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:39.535111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:39.543757 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:39.545343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:39.554567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1278/2565] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:41.614101 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:41.627394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03057304-51dd-4aa8-8772-58ac886fdacf None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:41.632947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:41.633552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:41.633832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:41.634134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:41.636361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:41.696350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:41.698043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:41.708535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1288/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:44.271868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:44.273362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:44.330528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa833c68-74a6-40ff-b0bc-28dae88c2b9a service swift] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:44.334098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:44.334691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:44.334966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:44.335234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:44.344650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:44.347230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:44.356498 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1279/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:51.703161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=31 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:54.352425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=32 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:56.144483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:56.153865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d18eb-d2df-4f2a-a022-9285389ab28d service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:56.157992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:56.158595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:56.158870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:56.159136 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:56.160849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:56.235114 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:56.236743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:56.246584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1289/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:59.617242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:59.618701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:59.647169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20bd18-cd30-4a86-bfa9-3b12d97026a5 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:59.654544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:59.655251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:59.655615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:59.655892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] PATH_INFO: `/v3/users/1c9de09d725f48db8cc9ac13a2ca3a52` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:59.657711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9de09d725f48db8cc9ac13a2ca3a52)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:59.659737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:59.712825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9de09d725f48db8cc9ac13a2ca3a52'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:59.720880 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9de09d725f48db8cc9ac13a2ca3a52'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:59.721503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9de09d725f48db8cc9ac13a2ca3a52'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:59.722112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9de09d725f48db8cc9ac13a2ca3a52'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:59.729306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-adc84b04-ac51-4ffe-a63c-2e32f0941065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9de09d725f48db8cc9ac13a2ca3a52'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:12:59.746509 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1280/2569] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:12:59 2022] DELETE /identity/v3/users/1c9de09d725f48db8cc9ac13a2ca3a52 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:12:59.932793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:59.944300 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb205b6-6433-4fbc-aea7-06020a5ae183 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.007742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.008354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.008631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.008901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] PATH_INFO: `/v3/projects/003b7712d023485baf3891233ad2cb67` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.010012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=003b7712d023485baf3891233ad2cb67)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.011933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.058449 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003b7712d023485baf3891233ad2cb67', 'request_id': 'req-f85bb648-c2e4-44d0-b10f-99230d0dda0a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:00.066448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003b7712d023485baf3891233ad2cb67', 'request_id': 'req-f85bb648-c2e4-44d0-b10f-99230d0dda0a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:00.072335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003b7712d023485baf3891233ad2cb67', 'request_id': 'req-f85bb648-c2e4-44d0-b10f-99230d0dda0a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:00.083822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] The token cache is being invalidate because project 003b7712d023485baf3891233ad2cb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:00.084109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:00.084746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-f85bb648-c2e4-44d0-b10f-99230d0dda0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:00.086278 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1290/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:12:59 2022] DELETE /identity/v3/projects/003b7712d023485baf3891233ad2cb67 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:00.091263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.091581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.091859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.111369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:00.112526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:00.171374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1281/2571] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:00.179677 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.179992 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.180308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.201568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:00.202846 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:00.211659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1291/2572] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:00.215960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.225957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c0ac8-9f79-467d-97ac-880adb5d1f4f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.230529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.231124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.231398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.231694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.232323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:00.232617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.234189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.246160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1282/2573] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:13:00.251113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.260508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb37b26-2607-4e61-8aa9-c8551e646544 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.265227 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.265899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.266179 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.266451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.267089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.269115 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.284999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:00.298538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1292/2574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:00.302945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.313445 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52547f-6b21-4e97-a77c-f3bc167c1f32 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.368750 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.369358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.369637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.369908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.370538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.372491 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.380825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:00.394299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1283/2575] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:00.398446 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.408763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f44f8-9b82-4d18-87af-4674eedb9236 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.413569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.414166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.414447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.414722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.415390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.417002 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.428062 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1293/2576] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:00.431801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.442911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143ed8f-5375-4fea-88c6-f804f86625d6 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.449129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.449832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.450175 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.450511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.451208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.452919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984dbe-f958-4555-be87-8c6c4752050a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.464271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1284/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:00.468554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.481993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207412c2-b0e3-4e1d-be45-6f637b589d32 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.487419 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.488098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.488681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.488681 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] PATH_INFO: `/v3/projects/48c7a5221280491e9e8b89c99019265c/users/b179db533c554f9d8b2af562babf1b5f/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.504757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c7a5221280491e9e8b89c99019265c, user_id=b179db533c554f9d8b2af562babf1b5f, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.507513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.522207 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1294/2578] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:00 2022] PUT /identity/v3/projects/48c7a5221280491e9e8b89c99019265c/users/b179db533c554f9d8b2af562babf1b5f/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:00.534467 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.534737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.535017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.565330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] MFA Rules not processed for user `b179db533c554f9d8b2af562babf1b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:00.566691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:00.638025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1285/2579] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:00.639480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.714601 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118d013-e62c-4b01-ae29-6dea21041295 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.719872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.720588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.721046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.721400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.722111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.724121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.760491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1295/2580] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:00.761680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.774128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433df255-feec-40eb-b2b0-7fd332d452fc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.856927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.857539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.857814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.858082 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.858735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.860700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.883566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1286/2581] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:00.886588 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.897903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce71241-2f79-4df9-8cb0-c7782d3abf5f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.902728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.904041 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.904396 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.904747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.905455 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.907268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.920525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1296/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:00.925023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.936552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbb366-aef1-43e7-86e5-bcd01b35cc0d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.942104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:00.942760 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.943041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.943309 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] PATH_INFO: `/v3/projects/2178c60e2ab6435f9c43e857a5268cba/users/37809c7bef684aeaa44f01be511cd18d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.962823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2178c60e2ab6435f9c43e857a5268cba, user_id=37809c7bef684aeaa44f01be511cd18d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:00.965513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:00.979595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1287/2583] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:00 2022] PUT /identity/v3/projects/2178c60e2ab6435f9c43e857a5268cba/users/37809c7bef684aeaa44f01be511cd18d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:00.984120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.997598 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec632b4-1bd9-43dc-902e-53dda4c553a4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:01.066901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:01.067550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:01.067828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:01.068097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:01.068953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:01.070310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a47413-4af4-4f75-9a1d-88d0e8026dc4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:01.084023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1297/2584] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:01.088096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:01.101912 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7f06-2b1f-494b-bbb7-3a4929042825 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:01.108426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:01.109104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:01.109920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:01.110242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] PATH_INFO: `/v3/projects/2178c60e2ab6435f9c43e857a5268cba/users/37809c7bef684aeaa44f01be511cd18d/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:01.112397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2178c60e2ab6435f9c43e857a5268cba, user_id=37809c7bef684aeaa44f01be511cd18d, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:01.115692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:01.129354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1288/2585] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:01 2022] PUT /identity/v3/projects/2178c60e2ab6435f9c43e857a5268cba/users/37809c7bef684aeaa44f01be511cd18d/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:01.139813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459120a-73a0-40c3-8072-460184969d4f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:01.140308 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459120a-73a0-40c3-8072-460184969d4f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:01.140671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459120a-73a0-40c3-8072-460184969d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:01.169496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d459120a-73a0-40c3-8072-460184969d4f None None] MFA Rules not processed for user `37809c7bef684aeaa44f01be511cd18d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:01.170722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d459120a-73a0-40c3-8072-460184969d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:01.194741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:01.271571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1298/2586] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:01.285898 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:01.290625 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:01.324847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:01.384911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55875d97-2a92-42de-aa8d-5985213272aa admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:01.390349 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:01.391894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:01.392405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:01.392777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:01.404225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:01.405955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f25f45-d2cc-42c2-a730-5683c888d352 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:01.418985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1289/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:02.887793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459120a-73a0-40c3-8072-460184969d4f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:02.949130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459120a-73a0-40c3-8072-460184969d4f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:02.954575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:02.955495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:02.955916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:02.956296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] PATH_INFO: `/v3/users/b179db533c554f9d8b2af562babf1b5f` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:02.957754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b179db533c554f9d8b2af562babf1b5f)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:02.960193 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:03.008162 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b179db533c554f9d8b2af562babf1b5f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.016133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b179db533c554f9d8b2af562babf1b5f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.016909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b179db533c554f9d8b2af562babf1b5f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.017518 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b179db533c554f9d8b2af562babf1b5f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.030008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b179db533c554f9d8b2af562babf1b5f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.042482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1299/2588] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:02 2022] DELETE /identity/v3/users/b179db533c554f9d8b2af562babf1b5f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:03.047183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.047727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.047832 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.068607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:03.070072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:03.132688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1290/2589] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:03.143046 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:03.144657 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:03.188932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:03.210499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa15dc2-3d4f-4614-94e0-b636f1b4c5a7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:03.214228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:03.214837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.215116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.215389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.225382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:03.227071 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:03.237774 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1300/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:03.533646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:03.535888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:03.557326 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749ea34-6cbb-43f7-b998-019f1a152fa1 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:03.562225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:03.563430 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.563756 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.564005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] PATH_INFO: `/v3/projects/48c7a5221280491e9e8b89c99019265c` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.565771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c7a5221280491e9e8b89c99019265c)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:03.568231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:03.620664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c7a5221280491e9e8b89c99019265c', 'request_id': 'req-1296cb5a-8022-4377-a0ab-2b48529c6e45'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.629941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c7a5221280491e9e8b89c99019265c', 'request_id': 'req-1296cb5a-8022-4377-a0ab-2b48529c6e45'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.635790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c7a5221280491e9e8b89c99019265c', 'request_id': 'req-1296cb5a-8022-4377-a0ab-2b48529c6e45'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.649663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] The token cache is being invalidate because project 48c7a5221280491e9e8b89c99019265c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:03.650029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.650824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.652367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1291/2591] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:03 2022] DELETE /identity/v3/projects/48c7a5221280491e9e8b89c99019265c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:03.657430 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:03.667266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdebf4-c47b-4c66-8612-7a94cc4a0dbc service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:03.742130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:03.742888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.743377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.743927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] PATH_INFO: `/v3/users/37809c7bef684aeaa44f01be511cd18d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.746097 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37809c7bef684aeaa44f01be511cd18d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:03.749304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:03.805216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37809c7bef684aeaa44f01be511cd18d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.814008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37809c7bef684aeaa44f01be511cd18d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.814651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37809c7bef684aeaa44f01be511cd18d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.815274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37809c7bef684aeaa44f01be511cd18d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.829715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2a84db5a-261c-4bb0-9add-c544feadfcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37809c7bef684aeaa44f01be511cd18d'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:03.844158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1301/2592] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:03 2022] DELETE /identity/v3/users/37809c7bef684aeaa44f01be511cd18d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:04.143414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.144938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.159215 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296cb5a-8022-4377-a0ab-2b48529c6e45 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.211403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:04.236263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.237881 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.238487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.239088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] PATH_INFO: `/v3/projects/2178c60e2ab6435f9c43e857a5268cba` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.241294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2178c60e2ab6435f9c43e857a5268cba)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.245225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.315032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2178c60e2ab6435f9c43e857a5268cba', 'request_id': 'req-f28f72da-a78a-4022-a704-fb57845a59ee'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.322944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2178c60e2ab6435f9c43e857a5268cba', 'request_id': 'req-f28f72da-a78a-4022-a704-fb57845a59ee'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.329183 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2178c60e2ab6435f9c43e857a5268cba', 'request_id': 'req-f28f72da-a78a-4022-a704-fb57845a59ee'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.340501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] The token cache is being invalidate because project 2178c60e2ab6435f9c43e857a5268cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:04.340790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.341447 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f28f72da-a78a-4022-a704-fb57845a59ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.342915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1292/2593] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:04 2022] DELETE /identity/v3/projects/2178c60e2ab6435f9c43e857a5268cba => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:04.348337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.348831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.349008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.369402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:04.370621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.423498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:04.435763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1302/2594] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:04.443296 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.443789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.444158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.464483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:04.465714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.475047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1293/2595] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:04.479789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.494428 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c03dd-f6b7-4abd-916b-1c8213aa7222 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.501669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.502745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.504800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.504800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.505154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:04.505714 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.508787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.535425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1303/2596] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:04.539693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.550621 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e3acf-0537-4375-a08f-7ad48f35a79f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.556325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.556928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.557198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.557474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.558110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.560040 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.565765 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.567670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.581229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012b423-8dab-43e2-b8a5-bc5508e08568 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.586830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.587648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.588019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.588355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] PATH_INFO: `/v3/users/b40c0fdee48745218654bbad8bac81a9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.589499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40c0fdee48745218654bbad8bac81a9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.590806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1294/2597] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:04 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:04.591405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.595902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.643012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40c0fdee48745218654bbad8bac81a9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.651891 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40c0fdee48745218654bbad8bac81a9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.652521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40c0fdee48745218654bbad8bac81a9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.653167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40c0fdee48745218654bbad8bac81a9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.661220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8e63-6603-4030-b921-76d5b07a49a7 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.665855 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.666453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.666732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.666900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40c0fdee48745218654bbad8bac81a9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:04.667020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.667661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.669573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.682468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1304/2598] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:04 2022] DELETE /identity/v3/users/b40c0fdee48745218654bbad8bac81a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:04.696099 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1295/2599] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:04 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:04.700156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.701533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.771546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4ebf2-f7ba-402d-aa39-8a583e2dbbbf admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.776307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.776916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.777197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.777473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.778121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.779752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.790755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1305/2600] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:04.794866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.805770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf923-33a9-4e5d-a7f4-aa4e4a3f5ada admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.810545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.811142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.811429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.811734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.812405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.814392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.825038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1296/2601] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:04.830252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.840610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f2bc8-7686-497e-8bd7-7f351d777e30 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.847642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.848333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.848643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.849008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] PATH_INFO: `/v3/projects/055a088bc62d46a6a8fad14b3b645c95/users/75f1d2a9923145be9d30ba5a863f43d0/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.867437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.868908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a088bc62d46a6a8fad14b3b645c95, user_id=75f1d2a9923145be9d30ba5a863f43d0, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.869678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.871591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697acf-17b7-4a60-8560-c9658158f039 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.887698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17b51-7563-44b5-99bf-68fbf027a9de admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.892328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1306/2602] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:04 2022] PUT /identity/v3/projects/055a088bc62d46a6a8fad14b3b645c95/users/75f1d2a9923145be9d30ba5a863f43d0/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:04.903789 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.904074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.904348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.924495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:04.934572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] MFA Rules not processed for user `75f1d2a9923145be9d30ba5a863f43d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:04.935852 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.954805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:04.964006 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.964638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.964916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.965186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] PATH_INFO: `/v3/projects/a7402fe2f2584c92b06f1a871a4b4330` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.966325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7402fe2f2584c92b06f1a871a4b4330)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.968270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.007963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1307/2603] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:05.012563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.017888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7402fe2f2584c92b06f1a871a4b4330', 'request_id': 'req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.024073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa870-1cba-4199-b0eb-00869d013da4 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.025903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7402fe2f2584c92b06f1a871a4b4330', 'request_id': 'req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.032069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7402fe2f2584c92b06f1a871a4b4330', 'request_id': 'req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.044059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] The token cache is being invalidate because project a7402fe2f2584c92b06f1a871a4b4330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:05.044350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.045015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.046507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1297/2604] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:04 2022] DELETE /identity/v3/projects/a7402fe2f2584c92b06f1a871a4b4330 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:05.050488 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.052172 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.088197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.088806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.089086 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.089357 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.089996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.091933 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.123971 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1308/2605] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:05.124176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75ae92-9196-4d7a-bca2-ca9cbd9dbb51 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.125942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.128199 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.178973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.179631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.179907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.180177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] PATH_INFO: `/v3/users/9410f2d320d549a4b9fb3cca685823ae` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.181285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9410f2d320d549a4b9fb3cca685823ae)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.183276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.189057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:05.195028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998ce54-a3c2-41ea-a03a-7a063ce583b1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.200100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.201068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.201356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.201632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.202265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.205076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.227810 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1309/2606] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:05.231718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.233332 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9410f2d320d549a4b9fb3cca685823ae'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.241833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9410f2d320d549a4b9fb3cca685823ae'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.242127 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b53438-3065-41e9-a366-be8ac05b1b23 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.242630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9410f2d320d549a4b9fb3cca685823ae'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.243262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9410f2d320d549a4b9fb3cca685823ae'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.246988 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.247621 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.247904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.248175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.248811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.251214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.251331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9410f2d320d549a4b9fb3cca685823ae'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.262435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1310/2607] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:05.267331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.269053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.270220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1298/2608] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:05 2022] DELETE /identity/v3/users/9410f2d320d549a4b9fb3cca685823ae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:05.282505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933c786-b2f8-4724-9627-a03c8a14d428 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.302940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:05.346943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.347761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.348044 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.348317 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.348958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.350583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651b22f-0a9b-4089-991e-6ab253d93dc1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.360812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1311/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:05.365045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.375531 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b11e2-c378-47ed-8886-9d04c4352de1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.380413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.381063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.381341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.381615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] PATH_INFO: `/v3/projects/cea0b25eef1441e3be36683518d4156b/users/f0a856b48e0f4cb692168384bacd3a82/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.397394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea0b25eef1441e3be36683518d4156b, user_id=f0a856b48e0f4cb692168384bacd3a82, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.400192 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.414136 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1299/2610] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:05 2022] PUT /identity/v3/projects/cea0b25eef1441e3be36683518d4156b/users/f0a856b48e0f4cb692168384bacd3a82/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:05.424733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.425155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.425567 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.448235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.449997 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.462568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] MFA Rules not processed for user `f0a856b48e0f4cb692168384bacd3a82`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:05.463839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.534418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1312/2611] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:05.535247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703760-9935-4c5a-8c6c-787c0368d7dc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.539070 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.540423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.541055 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.541325 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.541586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] PATH_INFO: `/v3/projects/cda60240da374196b3413a0b514d9256` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.542703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda60240da374196b3413a0b514d9256)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.544728 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.550547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ea25-b8cd-49fe-b0b0-f37c9f91691b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.555506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190513-a11f-421e-a049-665843c38540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.556110 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190513-a11f-421e-a049-665843c38540 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.556388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190513-a11f-421e-a049-665843c38540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.556658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60190513-a11f-421e-a049-665843c38540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.557284 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60190513-a11f-421e-a049-665843c38540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.559166 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60190513-a11f-421e-a049-665843c38540 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.587560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1313/2612] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:05.591631 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190513-a11f-421e-a049-665843c38540 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.595250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda60240da374196b3413a0b514d9256', 'request_id': 'req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.603818 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda60240da374196b3413a0b514d9256', 'request_id': 'req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.607924 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:05.612216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda60240da374196b3413a0b514d9256', 'request_id': 'req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.625368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] The token cache is being invalidate because project cda60240da374196b3413a0b514d9256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:05.625793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.626471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-3ae3b400-e80d-4c35-b8ba-8c2544d8c0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:05.628047 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1300/2613] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:05 2022] DELETE /identity/v3/projects/cda60240da374196b3413a0b514d9256 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:05.632829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468b69-39b6-473d-b3ab-7d158dc781fc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.633186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468b69-39b6-473d-b3ab-7d158dc781fc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.633461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09468b69-39b6-473d-b3ab-7d158dc781fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.654571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-09468b69-39b6-473d-b3ab-7d158dc781fc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:05.655838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-09468b69-39b6-473d-b3ab-7d158dc781fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.656935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60190513-a11f-421e-a049-665843c38540 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.661546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.662147 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.662432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.662698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.663343 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.664527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1301/2614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:05.665286 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.672851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.673124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.673391 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.694811 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1314/2615] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:05.695020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:05.695589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.695969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.697578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:05.703311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1302/2616] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:05.707527 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.710111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eed8f-b9c2-497c-83e0-a61da80bc5f2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.714787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.715383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.715697 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.715967 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.716432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4898-01f1-457f-b7b2-b23e514a2ccc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.716607 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.718187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.721258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.721876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.722132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.722383 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.723008 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:05.723301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.725027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.733032 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1315/2617] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:05.734894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.740825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1303/2618] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:13:05.741302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:05.742475 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.745298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4e501-9689-48df-ba46-1f2a87193ac6 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.752441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.753098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.753375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.753487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171853-a6ea-42a2-8c23-acfd789f1675 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.753644 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] PATH_INFO: `/v3/projects/55219614a80b4f49b2976d63b09301d7/users/2ca71b5eb89545f7ae57cc0823875602/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.758989 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.759619 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.759896 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.760163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.760783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.762697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.770109 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55219614a80b4f49b2976d63b09301d7, user_id=2ca71b5eb89545f7ae57cc0823875602, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.772795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.786417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1316/2619] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:05 2022] PUT /identity/v3/projects/55219614a80b4f49b2976d63b09301d7/users/2ca71b5eb89545f7ae57cc0823875602/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:05.790195 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.793730 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1304/2620] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:05.798125 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.858860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e47b3-db82-4bac-8a57-ca49015328b1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.862654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0d810-3d74-4ac2-b671-f7f66cc784ef admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.864614 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.865218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.865494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.865759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.866395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.867406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.867990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.868110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.868285 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.868627 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.869231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.871117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.878440 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1317/2621] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:05.882650 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.893245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51c3d-98f8-4a08-8a8a-777a5801d5cb admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.893612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1305/2622] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:05.897633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.898011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.898617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.898894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.899165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] PATH_INFO: `/v3/projects/55219614a80b4f49b2976d63b09301d7/users/2ca71b5eb89545f7ae57cc0823875602/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.901105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55219614a80b4f49b2976d63b09301d7, user_id=2ca71b5eb89545f7ae57cc0823875602, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.903746 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd332a7-42c4-4879-a8c3-a8803769ac08 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.908321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e454c-51a6-4252-8064-51f27976bf2d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.913394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:05.913976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.914365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.914638 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.914737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1318/2623] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:05 2022] PUT /identity/v3/projects/55219614a80b4f49b2976d63b09301d7/users/2ca71b5eb89545f7ae57cc0823875602/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:05.915784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:05.917362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:05.925809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:05.926418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:05.926754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:05.931635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1306/2624] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:05.932900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:05.942410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e91635-b0e7-4577-8c76-275897ce5ed8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:05.955687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] MFA Rules not processed for user `2ca71b5eb89545f7ae57cc0823875602`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:05.957143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.007009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.007677 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.007957 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.008229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.008856 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.010458 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.022403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1307/2625] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:06.026763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.041117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1319/2626] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:06.041960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24b89a-568a-4b0c-af71-7d0373bcf587 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.049398 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.050414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.050867 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.051612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] PATH_INFO: `/v3/projects/2b348a6b90f8407b83b62252d97258fa/users/5118f558745a4a00aad09fea63abe058/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.054410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.055848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.065494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:06.069146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b348a6b90f8407b83b62252d97258fa, user_id=5118f558745a4a00aad09fea63abe058, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.072337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dd22f-68b0-4427-874c-bd279394ce02 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.088646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1308/2627] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:06 2022] PUT /identity/v3/projects/2b348a6b90f8407b83b62252d97258fa/users/5118f558745a4a00aad09fea63abe058/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:06.100142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.100425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.100699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.113084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:06.117895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d944c65-49d6-4d1b-bafb-e91e09092063 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.133459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] MFA Rules not processed for user `5118f558745a4a00aad09fea63abe058`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:06.134670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.166954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.167684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.167960 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.168226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.200568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1309/2628] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:06.205710 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.230556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.232361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.242726 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1320/2629] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:06.270184 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc72e-37aa-4739-a90e-1fee037e8ad6 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.275223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.276157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.276539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.276814 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.277535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.279484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.309041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1310/2630] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:06.313899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.324577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e466-ed4d-4701-ac50-ef93e58ea5c8 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.383225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.383925 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.384156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.384422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.385076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.386947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.410204 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1321/2631] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:06.414222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.424991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125ce2c-5435-455e-bc24-50f0c94f93df admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.430390 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.431064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.431417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.431918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.432640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.434346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.445992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1311/2632] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:06.450268 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.465757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563423a1-c687-406e-825e-44cd65cf8d58 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.471258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.472009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.472290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.472565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.473214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.474791 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b70a-cd10-413b-afb6-8d71731dacda admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.485225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1322/2633] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:06.501724 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.512007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d8e3e-f989-4e0b-8463-8b612c33d725 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.528588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.528588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.528588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.528588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] PATH_INFO: `/v3/projects/14aad5479123484d9e5d6800877f6a3b/users/2e66926a4d2c48a58994d9a6089e1bb1/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.546539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14aad5479123484d9e5d6800877f6a3b, user_id=2e66926a4d2c48a58994d9a6089e1bb1, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.549991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.564127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1312/2634] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:06 2022] PUT /identity/v3/projects/14aad5479123484d9e5d6800877f6a3b/users/2e66926a4d2c48a58994d9a6089e1bb1/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:06.574605 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.574889 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.575163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.606702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] MFA Rules not processed for user `2e66926a4d2c48a58994d9a6089e1bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:06.608075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.631432 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:06.685216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1323/2635] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:06.690508 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.728219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:06.759224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcabd40-e130-4820-b367-c3d3bf1c76cd admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.764345 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.764947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.765219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.766282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.766671 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.768983 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.775154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.776643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.795686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1313/2636] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:06.799932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.837951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fa211-08a1-4526-8eb4-7b4d74219935 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.863139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5198e6-31bd-41c0-89fa-922fcee1d38f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.867933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.868666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.868944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.869216 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.869844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.871801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.887911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.888595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.888915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.889188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.891597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.898171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1314/2637] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:06.899160 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.908751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab74b7-8f77-4361-a661-c8cadf29de32 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.913694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.914278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.914565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.914833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.915457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.917067 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.928202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:06.932242 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:06.942812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32325ea2-e06c-479d-9434-21d0f9ebb045 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:06.947378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:06.948046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.948330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.948601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] PATH_INFO: `/v3/projects/23e069d9a388453db409a0cca7a7276a/users/dc7dbed341284a1fa0ee526ab4bbdfeb/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.957135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.958620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.966561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e069d9a388453db409a0cca7a7276a, user_id=dc7dbed341284a1fa0ee526ab4bbdfeb, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:06.969466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1324/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:06.972336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:06.986885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1316/2640] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:06 2022] PUT /identity/v3/projects/23e069d9a388453db409a0cca7a7276a/users/dc7dbed341284a1fa0ee526ab4bbdfeb/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:06.990978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:07.002544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bf93-792a-4a39-975a-cb1ef8a377e5 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:07.164742 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:07.195422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:07.196108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:07.196368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:07.196815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:07.197611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:07.199291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad53dd7-3179-4750-a3eb-5db1286f2f99 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:07.210950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1325/2641] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:07.215224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:07.226646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144665-a6f5-42e9-89b0-6261b458f26b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:07.232202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:07.233168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:07.233455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:07.233721 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] PATH_INFO: `/v3/projects/23e069d9a388453db409a0cca7a7276a/users/dc7dbed341284a1fa0ee526ab4bbdfeb/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:07.236484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e069d9a388453db409a0cca7a7276a, user_id=dc7dbed341284a1fa0ee526ab4bbdfeb, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:07.239168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:07.251015 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1317/2642] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:07 2022] PUT /identity/v3/projects/23e069d9a388453db409a0cca7a7276a/users/dc7dbed341284a1fa0ee526ab4bbdfeb/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:07.260975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:07.261680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:07.261680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:07.292739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] MFA Rules not processed for user `dc7dbed341284a1fa0ee526ab4bbdfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:07.293972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:07.376011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1326/2643] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:07.389596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:07.455968 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa073c3-1e1d-4e1c-9dd8-a62e77ebaf19 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:07.460275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:07.460883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:07.461155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:07.462419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:07.474674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:07.542347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:07.543842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:07.554811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1318/2644] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:09.158367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:09.167918 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625cc00-e5a0-4f4d-8b79-fea03f78d24e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:09.171399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:09.172584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:09.172861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:09.173126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:09.229682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:09.231057 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:09.240108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1327/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:09.798708 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:09.809109 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db297b-5d00-4db3-beda-fd4c9ece078d service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:09.813692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:09.814738 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:09.814845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:09.815060 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:09.825092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:09.826611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:09.842359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1319/2646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:11.083509 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:11.092093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f71c5-895f-455a-9b52-8e03e6ff7f61 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:11.096239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:11.096908 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:11.097250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:11.097582 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:11.099514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:11.155141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:11.167068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:11.168583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf528d3c-c083-44a2-b554-05ba546b5bf3 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:11.178289 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1328/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:13.371501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:13.432180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2edc0-7687-497e-8e83-4e7cc016fab9 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:13.436534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:13.437142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.437416 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.437746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] PATH_INFO: `/v3/users/75f1d2a9923145be9d30ba5a863f43d0` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.438906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f1d2a9923145be9d30ba5a863f43d0)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:13.440839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:13.500482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f1d2a9923145be9d30ba5a863f43d0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.509558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f1d2a9923145be9d30ba5a863f43d0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.510168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f1d2a9923145be9d30ba5a863f43d0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.510783 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f1d2a9923145be9d30ba5a863f43d0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.518641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f1d2a9923145be9d30ba5a863f43d0'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.537454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1320/2648] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:13 2022] DELETE /identity/v3/users/75f1d2a9923145be9d30ba5a863f43d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:13.541901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.542399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.542510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.562302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:13.563867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:13.623087 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1329/2649] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:13.632801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:13.634190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:13.653840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:13.694882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b9e4-36e9-49db-b021-832e9101479b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:13.698857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:13.699895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.699895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.700094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.712420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:13.713860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02fbc0-1de4-417b-b191-b9b360b2e2ed service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:13.723604 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1321/2650] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:13.749592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:13.752288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:13.764483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854375a3-297e-4f9b-a6a4-4b6a40fc87a8 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:13.769547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:13.770178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.770451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.770777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] PATH_INFO: `/v3/users/5118f558745a4a00aad09fea63abe058` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.772393 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5118f558745a4a00aad09fea63abe058)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:13.774403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:13.839536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5118f558745a4a00aad09fea63abe058'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.863210 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5118f558745a4a00aad09fea63abe058'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.863996 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5118f558745a4a00aad09fea63abe058'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.864642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5118f558745a4a00aad09fea63abe058'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.883116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5118f558745a4a00aad09fea63abe058'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:13.899259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1330/2651] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:13 2022] DELETE /identity/v3/users/5118f558745a4a00aad09fea63abe058 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:13.903494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.903793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.904071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.928034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:13.929234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.006234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1322/2652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:14.017777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.019824 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.038469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.039954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.061009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dcc11-6b36-4ccd-bb75-2ab8c01eedee None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.067245 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.067559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.067793 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.068064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] PATH_INFO: `/v3/projects/055a088bc62d46a6a8fad14b3b645c95` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.069263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055a088bc62d46a6a8fad14b3b645c95)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.071176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.108921 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0f1b9-216c-423f-abd7-ad53a41cb147 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.113525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.114173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.114451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.114724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.125584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.127662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.132422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055a088bc62d46a6a8fad14b3b645c95', 'request_id': 'req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.140167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1331/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:14.144817 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055a088bc62d46a6a8fad14b3b645c95', 'request_id': 'req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.152440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055a088bc62d46a6a8fad14b3b645c95', 'request_id': 'req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.169502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] The token cache is being invalidate because project 055a088bc62d46a6a8fad14b3b645c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:14.170028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.171107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.174283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1323/2654] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/projects/055a088bc62d46a6a8fad14b3b645c95 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:14.179050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.190985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961a82b-0dd3-49c7-a822-5ffc06246902 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.198305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:14.274542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.275422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.276098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.276521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] PATH_INFO: `/v3/users/f0a856b48e0f4cb692168384bacd3a82` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.278671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a856b48e0f4cb692168384bacd3a82)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.280895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.341786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a856b48e0f4cb692168384bacd3a82'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.351341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a856b48e0f4cb692168384bacd3a82'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.352137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a856b48e0f4cb692168384bacd3a82'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.352788 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a856b48e0f4cb692168384bacd3a82'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.369718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a856b48e0f4cb692168384bacd3a82'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.386834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1332/2655] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/users/f0a856b48e0f4cb692168384bacd3a82 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:14.462704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.464798 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.486820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbd132-9fdc-44f4-a0ef-05ea35d7e744 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.542071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:14.564205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.564205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.564205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.564205 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] PATH_INFO: `/v3/projects/2b348a6b90f8407b83b62252d97258fa` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.565420 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b348a6b90f8407b83b62252d97258fa)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.567410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.619412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b348a6b90f8407b83b62252d97258fa', 'request_id': 'req-4db101e1-df01-4a58-af77-7a2b451f93bc'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.628835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b348a6b90f8407b83b62252d97258fa', 'request_id': 'req-4db101e1-df01-4a58-af77-7a2b451f93bc'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.635692 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b348a6b90f8407b83b62252d97258fa', 'request_id': 'req-4db101e1-df01-4a58-af77-7a2b451f93bc'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.650073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] The token cache is being invalidate because project 2b348a6b90f8407b83b62252d97258fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:14.650341 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.650935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.652541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1324/2656] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/projects/2b348a6b90f8407b83b62252d97258fa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:14.657221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.659374 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.673273 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbcd5-1f40-48f4-92ca-791b835003f9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.710776 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.712327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.756155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.756795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.757066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.757333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] PATH_INFO: `/v3/users/2e66926a4d2c48a58994d9a6089e1bb1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.758482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e66926a4d2c48a58994d9a6089e1bb1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.760495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.787372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db101e1-df01-4a58-af77-7a2b451f93bc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.792654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:14.793540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.794378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.794809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.795157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] PATH_INFO: `/v3/projects/cea0b25eef1441e3be36683518d4156b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.796626 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea0b25eef1441e3be36683518d4156b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.799268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:14.817015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e66926a4d2c48a58994d9a6089e1bb1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.824792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e66926a4d2c48a58994d9a6089e1bb1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.825542 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e66926a4d2c48a58994d9a6089e1bb1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.826442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e66926a4d2c48a58994d9a6089e1bb1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.840015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e66926a4d2c48a58994d9a6089e1bb1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.849913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea0b25eef1441e3be36683518d4156b', 'request_id': 'req-fb2ad512-e7c1-4123-8f6d-cb621dd05082'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.853413 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1333/2657] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/users/2e66926a4d2c48a58994d9a6089e1bb1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:14.858369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea0b25eef1441e3be36683518d4156b', 'request_id': 'req-fb2ad512-e7c1-4123-8f6d-cb621dd05082'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.864701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea0b25eef1441e3be36683518d4156b', 'request_id': 'req-fb2ad512-e7c1-4123-8f6d-cb621dd05082'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.877617 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] The token cache is being invalidate because project cea0b25eef1441e3be36683518d4156b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:14.877900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.878579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:14.880116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1325/2658] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/projects/cea0b25eef1441e3be36683518d4156b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:14.884189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:14.885586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:14.954809 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c47d9-b980-451b-9633-30849c6ac030 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:14.961417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:14.962246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:14.962794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:14.963135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] PATH_INFO: `/v3/users/2ca71b5eb89545f7ae57cc0823875602` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:14.964451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca71b5eb89545f7ae57cc0823875602)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:14.966400 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:15.016805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca71b5eb89545f7ae57cc0823875602'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.025019 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca71b5eb89545f7ae57cc0823875602'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.025787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca71b5eb89545f7ae57cc0823875602'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.026412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca71b5eb89545f7ae57cc0823875602'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.039015 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca71b5eb89545f7ae57cc0823875602'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.052648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1334/2659] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:14 2022] DELETE /identity/v3/users/2ca71b5eb89545f7ae57cc0823875602 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:15.393803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:15.395742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.402641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.428680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:15.430388 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.473563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.503415 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad512-e7c1-4123-8f6d-cb621dd05082 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:15.532385 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30f11-7d01-4c2b-8536-03cc7c1a3b8c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:15.539003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:15.539690 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.539962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.540226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] PATH_INFO: `/v3/projects/14aad5479123484d9e5d6800877f6a3b` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.541499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14aad5479123484d9e5d6800877f6a3b)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:15.543378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:15.584528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:15.585473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.585715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.586003 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] PATH_INFO: `/v3/projects/55219614a80b4f49b2976d63b09301d7` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.587264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55219614a80b4f49b2976d63b09301d7)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:15.589352 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:15.604703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14aad5479123484d9e5d6800877f6a3b', 'request_id': 'req-7dc75678-0f28-4c54-9483-cbf01a38e880'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.613290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14aad5479123484d9e5d6800877f6a3b', 'request_id': 'req-7dc75678-0f28-4c54-9483-cbf01a38e880'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.619993 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14aad5479123484d9e5d6800877f6a3b', 'request_id': 'req-7dc75678-0f28-4c54-9483-cbf01a38e880'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.631945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] The token cache is being invalidate because project 14aad5479123484d9e5d6800877f6a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:15.632355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.633191 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.635058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1335/2660] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:15 2022] DELETE /identity/v3/projects/14aad5479123484d9e5d6800877f6a3b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:15.638752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:15.640176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.651678 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55219614a80b4f49b2976d63b09301d7', 'request_id': 'req-de34a127-b39f-4da9-997f-832a0f7f5287'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.660686 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55219614a80b4f49b2976d63b09301d7', 'request_id': 'req-de34a127-b39f-4da9-997f-832a0f7f5287'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.667262 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55219614a80b4f49b2976d63b09301d7', 'request_id': 'req-de34a127-b39f-4da9-997f-832a0f7f5287'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.679223 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] The token cache is being invalidate because project 55219614a80b4f49b2976d63b09301d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:15.679771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.680471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-de34a127-b39f-4da9-997f-832a0f7f5287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.683917 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1326/2661] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:15 2022] DELETE /identity/v3/projects/55219614a80b4f49b2976d63b09301d7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:15.689810 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b13a-a66b-4ef6-955b-4bf613769e8a None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.690239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b13a-a66b-4ef6-955b-4bf613769e8a None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.690614 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1b13a-a66b-4ef6-955b-4bf613769e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.711737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-03f1b13a-a66b-4ef6-955b-4bf613769e8a None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:15.711951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75678-0f28-4c54-9483-cbf01a38e880 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:15.713161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-03f1b13a-a66b-4ef6-955b-4bf613769e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.755908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.779584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:15.780337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.780691 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.781256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] PATH_INFO: `/v3/users/dc7dbed341284a1fa0ee526ab4bbdfeb` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.781991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1327/2662] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:15.783055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7dbed341284a1fa0ee526ab4bbdfeb)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:15.785084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:15.787671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:15.790319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.790699 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.791130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.811904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:15.813466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.822904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1328/2663] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:15.827011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:15.837739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a64eb-bfb2-4564-acc2-c29cf807caea None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:15.840208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7dbed341284a1fa0ee526ab4bbdfeb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.845090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:15.845972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.846337 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.846753 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.847915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:15.848407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:15.849667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7dbed341284a1fa0ee526ab4bbdfeb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.850496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:15.850803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7dbed341284a1fa0ee526ab4bbdfeb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.851717 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7dbed341284a1fa0ee526ab4bbdfeb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.867084 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1329/2664] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:13:15.868362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:15.870087 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.871093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7dbed341284a1fa0ee526ab4bbdfeb'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:15.884319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498a807-fbe8-4ba5-b5f6-865ede43d2f4 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:15.885936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1336/2665] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:15 2022] DELETE /identity/v3/users/dc7dbed341284a1fa0ee526ab4bbdfeb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:15.959993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:15.960947 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.961407 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.962049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.963063 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:15.965032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.000105 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1330/2666] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:15 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:16.004532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.015043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9267d8-8230-486d-82c1-e24e424c9445 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.082888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.083662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.084012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.084353 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.085184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.087159 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.109994 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1337/2667] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:16.114369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.125744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25d06-6e19-4be8-ad46-673820146002 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.130481 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.131081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.131357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.131653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.132287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.134190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.145413 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1331/2668] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:16.149874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.161049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83275870-3140-4aa4-a9f5-6437a15a9f4b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.166310 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.166948 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.167221 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.167559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.168579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.170243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15432f4-93c9-4044-bb4f-de0e609536fe admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.183668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1338/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:16.186091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.201258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3f67-7749-4030-bdf1-468dd4be5e14 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.206351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.207002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.207276 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.207570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] PATH_INFO: `/v3/projects/62704fc5b85d4e34a17b25cf66c82b4d/users/1ca3d0f8ebbd48ffa1bf164d8000d138/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.223046 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62704fc5b85d4e34a17b25cf66c82b4d, user_id=1ca3d0f8ebbd48ffa1bf164d8000d138, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.226166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.239664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1332/2670] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:16 2022] PUT /identity/v3/projects/62704fc5b85d4e34a17b25cf66c82b4d/users/1ca3d0f8ebbd48ffa1bf164d8000d138/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:16.251806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.252021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.252293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.282274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] MFA Rules not processed for user `1ca3d0f8ebbd48ffa1bf164d8000d138`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:16.283626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.331155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.332914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.340298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:16.372562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1339/2671] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:16.383012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.384303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.422363 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444003da-e13a-480d-93a3-f335398f5625 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.433240 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.434180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.435595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.436059 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] PATH_INFO: `/v3/projects/23e069d9a388453db409a0cca7a7276a` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.438404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e069d9a388453db409a0cca7a7276a)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.441286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.465661 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e9e92-52f3-408e-9fcd-4550b69248f2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.466913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:16.470443 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.471050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.471320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.471617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.482658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.484800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4e97-070b-4853-910e-6316a2de1982 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.505837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1340/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:16.516978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e069d9a388453db409a0cca7a7276a', 'request_id': 'req-10531ae2-f817-4a02-b120-8e121b89a42e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:16.531850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e069d9a388453db409a0cca7a7276a', 'request_id': 'req-10531ae2-f817-4a02-b120-8e121b89a42e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:16.538806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e069d9a388453db409a0cca7a7276a', 'request_id': 'req-10531ae2-f817-4a02-b120-8e121b89a42e'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:16.553357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] The token cache is being invalidate because project 23e069d9a388453db409a0cca7a7276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:16.553658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:16.554784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10531ae2-f817-4a02-b120-8e121b89a42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:16.556734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1333/2673] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:16 2022] DELETE /identity/v3/projects/23e069d9a388453db409a0cca7a7276a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:16.561415 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.561700 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.561973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.587629 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:16.588841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.692075 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1341/2674] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:16.697868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.698374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.698894 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.726219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:16.727690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.741323 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1334/2675] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:16.745632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.757052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab149-d693-400e-9ab1-101ab30254bf None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.762604 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.763330 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.763745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.764617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.765021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:16.765453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.768318 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.787422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1342/2676] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:16.792282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.806182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12aa0b-13e2-4352-b4d3-92618a9a74d4 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.819305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.820993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.820993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.820993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.821339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.823346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.934771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1335/2677] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:16.939327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.973203 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9f63-8a89-447a-b2f0-5135cd667235 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.088524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.089172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.089394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.089673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.090352 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.092709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.123236 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1343/2678] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:16 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:17.129218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.141128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c282890-5ef5-4dd5-8036-b96d73af2c69 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.148370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.149078 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.149426 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.149771 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.150510 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.152636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.174860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1336/2679] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:17.179142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.189990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967062c1-7c4e-445a-af9c-25ed78c010c4 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.194680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.195279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.195600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.195869 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.196499 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.198066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671b6a7-4cfb-4b65-92a5-e41b2915fd47 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.200757 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:17.213441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1344/2680] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:17.217722 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.231303 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2e989-8d19-417f-b41e-2d16c3e3a338 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.237441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.238107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.238411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.238711 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] PATH_INFO: `/v3/projects/d6c4260227644761bc65bb7961a72f99/users/aba3ab9b8f0747cd9689bc852cf3d5a6/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.254155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4260227644761bc65bb7961a72f99, user_id=aba3ab9b8f0747cd9689bc852cf3d5a6, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.256860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.279785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1337/2681] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:17 2022] PUT /identity/v3/projects/d6c4260227644761bc65bb7961a72f99/users/aba3ab9b8f0747cd9689bc852cf3d5a6/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:17.281763 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.282228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.282758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.312171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] MFA Rules not processed for user `aba3ab9b8f0747cd9689bc852cf3d5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:17.313723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:17.381894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1345/2682] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:17.386449 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.465133 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2379d29-a091-486f-bdc1-98d85ffa25ed admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.471166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.472228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.473037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.473374 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.474306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.476765 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.511441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1338/2683] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:17.515679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.530834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fbe4e-4164-4d7c-9124-b86af6b48ae7 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.604568 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.605188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.605469 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.605741 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.606377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.608306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.632012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1346/2684] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:17 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:17.636102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.648025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57e738-888e-47e4-bf51-0e57efaecd8e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.652919 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.653656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.653844 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.654195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.654741 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.657019 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.668592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1339/2685] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:17.672893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.683434 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3d586-c3e6-42fc-9452-8528d76834ec admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.688837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.688965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.689169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.689402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.690042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.691667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e42455-433b-45e0-8cae-bf68f2d46dc5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.702589 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1347/2686] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:17.707735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.721846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7646a-44a7-4f5a-b61b-4aa1bea10ad8 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.727041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.727861 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.728142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.728417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] PATH_INFO: `/v3/projects/87e4fe3e5cdf494bb45e62f45bc93c04/users/6c148378bdef4ecb97264af05c4cc312/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.740878 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:17.746546 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e4fe3e5cdf494bb45e62f45bc93c04, user_id=6c148378bdef4ecb97264af05c4cc312, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.749745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:17.763004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1340/2687] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:17 2022] PUT /identity/v3/projects/87e4fe3e5cdf494bb45e62f45bc93c04/users/6c148378bdef4ecb97264af05c4cc312/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:17.775213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.775974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.775974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.806544 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] MFA Rules not processed for user `6c148378bdef4ecb97264af05c4cc312`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:17.807858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:17.866583 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:17.885083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1348/2688] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:17.886360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:17.968152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8d6a-9ac8-4e40-8e57-f109e41eede5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:17.973955 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:17.974693 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:17.975127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:17.975411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:17.976292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:17.978328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.013246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1341/2689] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:17 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:18.014526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.040747 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415b81-6ab6-4f00-944d-677a0d85ff41 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.154129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.154767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.155095 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.155372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.165728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.168521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.196755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1349/2690] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:18 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:18.200702 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.218208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1cf50-6301-4dba-9b18-cc3d66da178f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.224438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.225134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.225521 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.225834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.226581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.229050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.243595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1342/2691] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:18.246003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.259593 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169dc7a-94e5-4c8b-94ce-c0297fc3142a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.267552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.268323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.269178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.269456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] PATH_INFO: `/v3/projects/822c9a96dec2473596b65169696f6e04/users/c77511f1eaaf44388b87ca4fd66f4f2a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.288579 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822c9a96dec2473596b65169696f6e04, user_id=c77511f1eaaf44388b87ca4fd66f4f2a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.291989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.319718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1350/2692] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:18 2022] PUT /identity/v3/projects/822c9a96dec2473596b65169696f6e04/users/c77511f1eaaf44388b87ca4fd66f4f2a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:18.320897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.333926 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a9206-68fb-42aa-bcba-07272b15358a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.393703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.394319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.394601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.394870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.395533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.397127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ea73-8d62-4c4f-ab13-d3bd6f0d4473 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.407736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1343/2693] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:18.411866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.422932 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca0b24-39e2-4137-98df-90d3a13914d8 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.427943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.428603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.429029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.429303 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] PATH_INFO: `/v3/projects/822c9a96dec2473596b65169696f6e04/users/c77511f1eaaf44388b87ca4fd66f4f2a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.431255 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=822c9a96dec2473596b65169696f6e04, user_id=c77511f1eaaf44388b87ca4fd66f4f2a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.433902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.447209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1351/2694] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:18 2022] PUT /identity/v3/projects/822c9a96dec2473596b65169696f6e04/users/c77511f1eaaf44388b87ca4fd66f4f2a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:18.458636 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.458914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.459182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.492053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] MFA Rules not processed for user `c77511f1eaaf44388b87ca4fd66f4f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:18.493319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:18.555016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:18.580194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1344/2695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:18.592422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:18.594867 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:18.658823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279cc4-1538-49b4-a9c4-8a26817f68ce admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:18.662830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:18.663447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.663766 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.664037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.725533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:18.727029 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:18.737395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1352/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:20.302187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:20.312138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3f0c-b09f-4a70-8c1c-1175f4361bea None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:20.316392 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:20.316568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:20.316808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:20.317077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:20.376268 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:20.377837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:20.386800 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1345/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:20.950887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:20.955870 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:20.962035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a70e2-8b1f-45c6-8e53-da8df3a28d1e service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:20.966355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:20.966953 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:20.967226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:20.967520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:20.977708 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:20.979251 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:20.990007 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1353/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:21.377210 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:21.378656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:21.439824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f4ed-0466-4c6b-9f4d-3732dab98746 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:21.443654 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:21.444270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:21.444736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:21.445124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:21.447077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:21.517292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:21.518775 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:21.529179 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1346/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:24.976525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:24.989547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef80a-4f87-4606-8efe-ce5a169f4109 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:24.994590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:24.995256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:24.995575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:24.995848 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] PATH_INFO: `/v3/users/aba3ab9b8f0747cd9689bc852cf3d5a6` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:24.997135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba3ab9b8f0747cd9689bc852cf3d5a6)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:24.999049 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.035503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.037092 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.051895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e80d8-ade7-404b-afb5-74664ec7bb01 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.061848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.063417 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.063988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.064528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] PATH_INFO: `/v3/users/09278399bc0148e68f0c7204fe19dc59` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.066387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09278399bc0148e68f0c7204fe19dc59)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.067169 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba3ab9b8f0747cd9689bc852cf3d5a6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.068547 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.075555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba3ab9b8f0747cd9689bc852cf3d5a6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.077010 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba3ab9b8f0747cd9689bc852cf3d5a6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.079787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba3ab9b8f0747cd9689bc852cf3d5a6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.092962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e95c814f-834c-45f8-abd9-cf9400d08136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba3ab9b8f0747cd9689bc852cf3d5a6'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.103108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.107651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1354/2700] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:24 2022] DELETE /identity/v3/users/aba3ab9b8f0747cd9689bc852cf3d5a6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:25.113514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.113805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.114076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.124107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09278399bc0148e68f0c7204fe19dc59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.133213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09278399bc0148e68f0c7204fe19dc59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.133920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09278399bc0148e68f0c7204fe19dc59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.134568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09278399bc0148e68f0c7204fe19dc59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.134866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:25.136131 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.142014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09278399bc0148e68f0c7204fe19dc59'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.163386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1347/2701] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:25 2022] DELETE /identity/v3/users/09278399bc0148e68f0c7204fe19dc59 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:25.206861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1355/2702] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:25.216712 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.218923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.282590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a005a57-141e-4615-8be0-8269edcc8794 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.287394 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.288072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.288354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.288629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.346578 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.348587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.361688 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc41a6b-b621-436c-bcf9-f65881bf367d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.367302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.367492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.368001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.368276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.368545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] PATH_INFO: `/v3/projects/be2fdd4f07d94684aabb53b73a014123` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.368874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666f688-7563-4b6e-b6b8-16f7ef578bb2 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.369702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2fdd4f07d94684aabb53b73a014123)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.371635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.379841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1348/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:25.429668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2fdd4f07d94684aabb53b73a014123', 'request_id': 'req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.438129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2fdd4f07d94684aabb53b73a014123', 'request_id': 'req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.439587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.446402 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2fdd4f07d94684aabb53b73a014123', 'request_id': 'req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.459775 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] The token cache is being invalidate because project be2fdd4f07d94684aabb53b73a014123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:25.460074 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.460804 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-acdac6c2-ac8d-4c3e-9185-8cba8a1c3b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.462379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1356/2704] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:25 2022] DELETE /identity/v3/projects/be2fdd4f07d94684aabb53b73a014123 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:25.467502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa725-1928-4367-b972-9ae392db9936 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.467791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa725-1928-4367-b972-9ae392db9936 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.468061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa725-1928-4367-b972-9ae392db9936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.490752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-082aa725-1928-4367-b972-9ae392db9936 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:25.492081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-082aa725-1928-4367-b972-9ae392db9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.552124 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.566922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1349/2705] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:25.574755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.575038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.575319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.596403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:25.597628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.605537 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1357/2706] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:25.610700 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa725-1928-4367-b972-9ae392db9936 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.620339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa725-1928-4367-b972-9ae392db9936 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.625234 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.625841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.626118 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.626386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.627025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:25.627324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.628950 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.640935 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1350/2707] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:25.645421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.654530 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0eca-ffa1-4dbf-98c7-3ad86d3347e1 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.660474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.661080 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.661377 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.661640 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.662429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.663597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.664333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.665346 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.681368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79699a6d-72fe-44fd-959a-f98fb025a486 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.688132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.688928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.689357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.689808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] PATH_INFO: `/v3/projects/d6c4260227644761bc65bb7961a72f99` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.691513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c4260227644761bc65bb7961a72f99)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.694049 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.701052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1358/2708] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:25 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:25.705797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.747923 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c4260227644761bc65bb7961a72f99', 'request_id': 'req-5dcd6727-b419-43d3-8671-ec5969b2d331'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.755587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c4260227644761bc65bb7961a72f99', 'request_id': 'req-5dcd6727-b419-43d3-8671-ec5969b2d331'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.761173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c4260227644761bc65bb7961a72f99', 'request_id': 'req-5dcd6727-b419-43d3-8671-ec5969b2d331'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.770558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708f7cd-526c-4757-8710-8802c53ed375 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.773318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] The token cache is being invalidate because project d6c4260227644761bc65bb7961a72f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:25.773612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.774265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.776098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1351/2709] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:25 2022] DELETE /identity/v3/projects/d6c4260227644761bc65bb7961a72f99 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:25.779961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.781802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.833060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.833669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.833942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.834206 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.834823 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.836733 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.851388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd6727-b419-43d3-8671-ec5969b2d331 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.856864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.857487 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.857925 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.858204 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] PATH_INFO: `/v3/users/6c148378bdef4ecb97264af05c4cc312` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.859412 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c148378bdef4ecb97264af05c4cc312)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.862945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1359/2710] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:25 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:25.863111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.864777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.866460 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.878571 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44238a-b5c0-418c-8008-5f11c28eb9c7 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.883337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.883969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.884241 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.884510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.885149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.886710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.897670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1360/2711] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:25.901793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.912872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee58fe7-dec8-4e68-b922-627378dc35cc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.913154 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c148378bdef4ecb97264af05c4cc312'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.918535 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.919134 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.919547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.919710 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.920546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.921250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c148378bdef4ecb97264af05c4cc312'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.921927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c148378bdef4ecb97264af05c4cc312'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.922482 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.922650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c148378bdef4ecb97264af05c4cc312'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.934434 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-9f5a8771-2861-4df6-9521-6ee159326cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c148378bdef4ecb97264af05c4cc312'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:25.935833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1361/2712] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:25.942472 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.942715 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.945474 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.961417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c342d-fe42-4592-bf2f-513402bf804b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.966052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.966698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.966970 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.967381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] PATH_INFO: `/v3/projects/594967ece9a9469a98aaaee03f83e070/users/44eba9106ff54a909097477d7b266d56/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.981305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1352/2713] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:25 2022] DELETE /identity/v3/users/6c148378bdef4ecb97264af05c4cc312 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:25.987881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594967ece9a9469a98aaaee03f83e070, user_id=44eba9106ff54a909097477d7b266d56, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.990723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.009165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1362/2714] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:25 2022] PUT /identity/v3/projects/594967ece9a9469a98aaaee03f83e070/users/44eba9106ff54a909097477d7b266d56/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:26.020830 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.021117 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.021377 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.060537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] MFA Rules not processed for user `44eba9106ff54a909097477d7b266d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:26.061610 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.143298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1353/2715] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:26.162620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.166969 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.192048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:26.270885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387e76-f9f6-44bb-b051-deb96f3c9920 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:26.276849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:26.277451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.277802 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.278069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.287768 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:26.289354 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.292823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.294563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.307403 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1363/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:26.393889 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcf39a-657c-498d-88c6-54a51dfe2014 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:26.399994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:26.400882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.401163 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.401436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] PATH_INFO: `/v3/projects/87e4fe3e5cdf494bb45e62f45bc93c04` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.402649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e4fe3e5cdf494bb45e62f45bc93c04)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:26.404648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.465601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e4fe3e5cdf494bb45e62f45bc93c04', 'request_id': 'req-e715e7b6-f65f-4756-9de2-8ae9ed612551'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.474701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e4fe3e5cdf494bb45e62f45bc93c04', 'request_id': 'req-e715e7b6-f65f-4756-9de2-8ae9ed612551'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.480801 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e4fe3e5cdf494bb45e62f45bc93c04', 'request_id': 'req-e715e7b6-f65f-4756-9de2-8ae9ed612551'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.501496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] The token cache is being invalidate because project 87e4fe3e5cdf494bb45e62f45bc93c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:26.501952 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.503119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.507591 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1354/2717] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:26 2022] DELETE /identity/v3/projects/87e4fe3e5cdf494bb45e62f45bc93c04 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:26.509072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.525022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1ac6-13ba-43b7-b0d9-56b1aae0799c service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:26.549171 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.550577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.557620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:26.594022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:26.594796 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.595121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.595346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] PATH_INFO: `/v3/users/c77511f1eaaf44388b87ca4fd66f4f2a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.596538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77511f1eaaf44388b87ca4fd66f4f2a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:26.598468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.628058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715e7b6-f65f-4756-9de2-8ae9ed612551 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:26.633364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:26.634130 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.634384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.634719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] PATH_INFO: `/v3/users/44eba9106ff54a909097477d7b266d56` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.636026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44eba9106ff54a909097477d7b266d56)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:26.638186 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.653118 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77511f1eaaf44388b87ca4fd66f4f2a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.662940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77511f1eaaf44388b87ca4fd66f4f2a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.663729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77511f1eaaf44388b87ca4fd66f4f2a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.664521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77511f1eaaf44388b87ca4fd66f4f2a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.682395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b1f17ee8-d7e8-4ff5-a854-7a85f4168443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77511f1eaaf44388b87ca4fd66f4f2a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.697922 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1364/2718] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:26 2022] DELETE /identity/v3/users/c77511f1eaaf44388b87ca4fd66f4f2a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:26.698256 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44eba9106ff54a909097477d7b266d56'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.707661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44eba9106ff54a909097477d7b266d56'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.708331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44eba9106ff54a909097477d7b266d56'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.708959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44eba9106ff54a909097477d7b266d56'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.716713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44eba9106ff54a909097477d7b266d56'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:26.735986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1355/2719] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:26 2022] DELETE /identity/v3/users/44eba9106ff54a909097477d7b266d56 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:26.740855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.741138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.741408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.761189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:26.762507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.767735 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:26.832487 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1365/2720] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:26.842524 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.845499 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:26.907886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885710-77d8-488a-ac76-96e2b5b6bb73 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:26.911663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:26.912277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:26.912558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:26.912828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:26.923263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:26.924902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0019cb-51e5-4280-b275-bdc302a58147 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:26.935680 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1356/2721] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:26.987495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:26.989417 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.004321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657883-4cce-407c-9438-cdfe0d83579d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.009893 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.010630 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.010980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.011320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] PATH_INFO: `/v3/projects/822c9a96dec2473596b65169696f6e04` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.012663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822c9a96dec2473596b65169696f6e04)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.015156 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.067973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822c9a96dec2473596b65169696f6e04', 'request_id': 'req-8cd0293b-6012-4420-a1b1-2c15a6f3d991'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.076457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822c9a96dec2473596b65169696f6e04', 'request_id': 'req-8cd0293b-6012-4420-a1b1-2c15a6f3d991'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.083395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822c9a96dec2473596b65169696f6e04', 'request_id': 'req-8cd0293b-6012-4420-a1b1-2c15a6f3d991'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.099849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] The token cache is being invalidate because project 822c9a96dec2473596b65169696f6e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:27.100229 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.101060 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8cd0293b-6012-4420-a1b1-2c15a6f3d991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.107888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1366/2722] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:26 2022] DELETE /identity/v3/projects/822c9a96dec2473596b65169696f6e04 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:27.109264 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.110305 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.110574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.131237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.132629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.161594 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:27.207853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1357/2723] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:27.215962 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.216265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.216954 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.254211 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.254911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.256379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.259290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.268467 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1367/2724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:27.271001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.275507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414a239-8b12-4136-8ce4-68e801e5163b None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.280567 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.281812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.282095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.282347 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] PATH_INFO: `/v3/projects/594967ece9a9469a98aaaee03f83e070` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.282752 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d8516-a668-4f30-bf07-95cb64209dad None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.283740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594967ece9a9469a98aaaee03f83e070)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.285787 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.288557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.289167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.289447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.289718 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.290556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:27.290858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.293038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.321536 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1368/2725] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:27.322771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.338643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124579e-16ab-430b-9556-11b59af340e6 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.350368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594967ece9a9469a98aaaee03f83e070', 'request_id': 'req-511ce944-8db2-4a9f-b633-6bdbb27e5769'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.361544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594967ece9a9469a98aaaee03f83e070', 'request_id': 'req-511ce944-8db2-4a9f-b633-6bdbb27e5769'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.372228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594967ece9a9469a98aaaee03f83e070', 'request_id': 'req-511ce944-8db2-4a9f-b633-6bdbb27e5769'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.384681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] The token cache is being invalidate because project 594967ece9a9469a98aaaee03f83e070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:27.385103 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.385860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-511ce944-8db2-4a9f-b633-6bdbb27e5769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:27.387435 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1358/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:27 2022] DELETE /identity/v3/projects/594967ece9a9469a98aaaee03f83e070 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:27.393838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ed0-4dc9-48f1-a38e-6abe76f92d7f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.394388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ed0-4dc9-48f1-a38e-6abe76f92d7f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.394723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489ed0-4dc9-48f1-a38e-6abe76f92d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.413596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.414214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.414494 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.414769 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.415441 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.417394 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.417921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-d0489ed0-4dc9-48f1-a38e-6abe76f92d7f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.419202 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-d0489ed0-4dc9-48f1-a38e-6abe76f92d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.431506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1359/2727] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:27.438432 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.438715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.439005 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.452304 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:27.460606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1369/2728] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:27.465647 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.467652 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.471013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.473188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.539533 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc56e65-e5e9-49a9-b5a0-9b5a41ee8bbf admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.542386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1360/2729] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:27.545758 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.546491 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.546792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.547137 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.547362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.547800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.549701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.557497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd5fc7-5b1c-43e3-9b89-e050505b3b9f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.563895 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.564628 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.564982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.565300 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.565956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:27.566267 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.568111 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.573531 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1370/2730] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:27.578827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.585789 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1361/2731] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:13:27.587061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.589896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdac20-19fb-483b-b013-53003dbe4914 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.596799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.597835 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.598351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.598815 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.600161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.602102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.603089 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c961b-6115-470a-8302-b23279a544aa admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.611138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.611138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.611138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.611138 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.612044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.615339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.621562 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1371/2732] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:27.623257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.633863 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252c484-5053-489e-9272-6b8fc81bd200 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.638890 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.639546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.639885 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.640185 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.641676 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.643581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.648424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1362/2733] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:27.653396 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.659833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1372/2734] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:27.663911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.664146 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:27.676122 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db299faa-6b3a-4d30-96d5-ea61ac5d6f59 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.726674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956645d2-f88e-445f-bf65-6432060810bf admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.731581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.732360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.732897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.733178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.733870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.736361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.736511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.737916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.737916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.737916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] PATH_INFO: `/v3/projects/0b5a95119d1d4d5c81fcc447ac125df1/users/b94cb202d7634a71b1215830bafaca79/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.753484 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5a95119d1d4d5c81fcc447ac125df1, user_id=b94cb202d7634a71b1215830bafaca79, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.756158 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96583208-8bec-405e-8707-5b52ca0cff2f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.758891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1363/2735] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:27.762951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.770072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1373/2736] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:27 2022] PUT /identity/v3/projects/0b5a95119d1d4d5c81fcc447ac125df1/users/b94cb202d7634a71b1215830bafaca79/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:27.773395 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de847d-e1e9-439e-9ffb-82f19cbb9292 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.838229 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.838466 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.838734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.838838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.839005 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.839106 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.839265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.839941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.841526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.853545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1364/2737] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:27.857241 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.867507 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ebd6-9f51-451a-8ab6-bc98c1c78b09 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.869305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] MFA Rules not processed for user `b94cb202d7634a71b1215830bafaca79`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.870554 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.872623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.873217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.873493 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.873762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.874388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.876176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.886701 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1365/2738] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:27.890916 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.900461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3f1af-18e2-4777-9acb-e91cc7190378 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:27.905061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:27.905811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.906631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.906903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] PATH_INFO: `/v3/projects/5277589b37154f9fbf10ad1de90fd152/users/b16dc01216e5459e9562dbce23eac3ce/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.914066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:27.923372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5277589b37154f9fbf10ad1de90fd152, user_id=b16dc01216e5459e9562dbce23eac3ce, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:27.926302 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cb54c-ebb9-4161-9cc8-3b10b01a45c3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:27.941523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1366/2739] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:27 2022] PUT /identity/v3/projects/5277589b37154f9fbf10ad1de90fd152/users/b16dc01216e5459e9562dbce23eac3ce/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:27.942698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1374/2740] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:27.952288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:27.952629 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:27.953512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:27.954850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:27.957138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:27.982387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] MFA Rules not processed for user `b16dc01216e5459e9562dbce23eac3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:27.983649 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:28.016198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f634475-8a90-4d08-8bc7-2300eb5cad7b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.032951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:28.054195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1367/2741] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:28.059428 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.066886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.067508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.067786 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.068051 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.125444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b54e45-44b8-4e24-a78f-bc0db22bb9bd None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.128333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.129806 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.130255 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.130870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.131149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.131423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.132104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.134013 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.138724 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1375/2742] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:28.164324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1368/2743] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:28 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:28.165506 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.177324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717e42-f414-46c0-8fe2-ad9a77a45560 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.224548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:28.236259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.236866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.237145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.237416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.238038 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.239999 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.261734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1376/2744] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:28 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:28.266187 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.276965 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c450cc-bac0-47eb-9725-5238dd186a0c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.282129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.282859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.283076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.283569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.284327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.286151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.299523 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1369/2745] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:28.303744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.315704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437d7c2-1a88-491e-9fef-b16f11dd783b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.322628 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.323283 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.323584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.323888 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] PATH_INFO: `/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94/users/2794607184c2479e883c50faff60c74a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.340406 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb719aa0fbc45b89dee52e6138e2f94, user_id=2794607184c2479e883c50faff60c74a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.343266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.364063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1377/2746] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:28 2022] PUT /identity/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94/users/2794607184c2479e883c50faff60c74a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:28.365237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.375598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954145-3cbf-474e-a76e-03c5e17b3941 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.444482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.445167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.445988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.445988 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.446419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.448058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2a2f7-4e1c-47fe-b2c9-5c2e1726a3b1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.461646 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1370/2747] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:28.465669 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.478861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b67a7-4969-49e2-a399-ea046b912fb9 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.483725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.485362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.485362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.486573 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] PATH_INFO: `/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94/users/2794607184c2479e883c50faff60c74a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.491572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb719aa0fbc45b89dee52e6138e2f94, user_id=2794607184c2479e883c50faff60c74a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.491572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.503750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1378/2748] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:28 2022] PUT /identity/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94/users/2794607184c2479e883c50faff60c74a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:28.514943 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.515056 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.515312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.562684 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] MFA Rules not processed for user `2794607184c2479e883c50faff60c74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:28.564437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:28.613977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:28.614146 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.616367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:28.637689 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1371/2749] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:28.651094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.685302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c639c-d1fb-4092-83be-fcd0d26c1f22 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.690053 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.690771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.691006 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.691216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] PATH_INFO: `/v3/users/1ca3d0f8ebbd48ffa1bf164d8000d138` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.692407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca3d0f8ebbd48ffa1bf164d8000d138)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.694298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.710433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77fda1-37af-4bc4-ada0-bb990d0f4abc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.713784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.714388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.714668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.714941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.725505 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:28.726973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022405c6-fef0-411e-a140-945df4c574fe service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:28.737483 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1372/2750] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:28.749751 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca3d0f8ebbd48ffa1bf164d8000d138'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:28.758022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca3d0f8ebbd48ffa1bf164d8000d138'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:28.758707 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca3d0f8ebbd48ffa1bf164d8000d138'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:28.759478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca3d0f8ebbd48ffa1bf164d8000d138'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:28.777839 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca3d0f8ebbd48ffa1bf164d8000d138'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:28.798256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1379/2751] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:28 2022] DELETE /identity/v3/users/1ca3d0f8ebbd48ffa1bf164d8000d138 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:28.802058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.802058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.802058 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:28.824397 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:28.825615 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:28.892379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1373/2752] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:28.902941 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:28.904439 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:28.936500 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:28.990018 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02713-c8ae-4bd0-b6cf-4fa08bef189c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:28.994365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:28.995105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:28.995594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:28.995989 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.007668 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.009956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77437be0-a25b-4be7-af0d-19d93e396975 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.024244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1380/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:29.206221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.207762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.220238 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5b0b1-cf7d-482a-b2fb-88c37b51b5cc None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.224859 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.225484 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.225762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.226032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] PATH_INFO: `/v3/users/b16dc01216e5459e9562dbce23eac3ce` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.227148 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16dc01216e5459e9562dbce23eac3ce)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.229104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.278219 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16dc01216e5459e9562dbce23eac3ce'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.287298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16dc01216e5459e9562dbce23eac3ce'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.287974 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16dc01216e5459e9562dbce23eac3ce'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.288581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16dc01216e5459e9562dbce23eac3ce'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.296177 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16dc01216e5459e9562dbce23eac3ce'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.311824 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:29.316727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1374/2754] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:29 2022] DELETE /identity/v3/users/b16dc01216e5459e9562dbce23eac3ce => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:29.328749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.329529 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.330287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.337870 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.339648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.356465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:29.358946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.423336 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478b4a-b3e5-4889-92f1-0793a38ebedc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.426699 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1381/2755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:29.429271 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.430635 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.430991 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.431339 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] PATH_INFO: `/v3/projects/62704fc5b85d4e34a17b25cf66c82b4d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.432624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62704fc5b85d4e34a17b25cf66c82b4d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.434577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.436389 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.438307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.488312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62704fc5b85d4e34a17b25cf66c82b4d', 'request_id': 'req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.498190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62704fc5b85d4e34a17b25cf66c82b4d', 'request_id': 'req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.504918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62704fc5b85d4e34a17b25cf66c82b4d', 'request_id': 'req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.506437 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da566f-af77-4dfd-b5fb-d5a9c050a2e3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.522592 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] The token cache is being invalidate because project 62704fc5b85d4e34a17b25cf66c82b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:29.522875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.523568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-5998b2ba-aa68-450d-b4d8-910ef84fa9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:29.525537 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1375/2756] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:29 2022] DELETE /identity/v3/projects/62704fc5b85d4e34a17b25cf66c82b4d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:29.539707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d998-2c05-4c19-a4d4-ee832b3a034f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.539992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d998-2c05-4c19-a4d4-ee832b3a034f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.540408 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d998-2c05-4c19-a4d4-ee832b3a034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.561218 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6819d998-2c05-4c19-a4d4-ee832b3a034f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:29.563149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6819d998-2c05-4c19-a4d4-ee832b3a034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.565314 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.566269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.566704 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.567271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.569341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.607209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=100 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:29.636754 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1376/2757] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:29.644455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.644729 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.644954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.646503 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.648061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.660974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1382/2758] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:29.666057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:29.667516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:29.676796 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1377/2759] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:29.681909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.695105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56823588-8fff-4c57-ad29-a65cfe600180 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.702209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.702866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.703197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.703488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.704197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:29.705850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.707483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.724581 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1383/2760] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:29.733601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.747419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832985c-8dfb-42a4-91de-707c5cf5c671 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.755080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.755799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.756258 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.756860 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.758050 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.761829 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.798668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1378/2761] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:29.800297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.810626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f4ad-2ed2-4522-a207-7efc7e899e3f admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.881713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.882331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.882633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.883037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.883706 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.885626 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.915596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1384/2762] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:29 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:29.917709 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.924052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:29.931590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d14c5a-04c5-4bd1-a99f-8176391c4d5d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.938779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.939425 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.939733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.940007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.940644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.942275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.954128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1379/2763] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:29.958306 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:29.968627 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde1e9b-da45-4841-ab70-bbb070ae28ed admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:29.973785 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:29.974387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:29.975309 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:29.975672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:29.976320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:29.977897 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:29.989463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1385/2764] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:29.993769 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.006907 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2382367-4e67-406f-9482-e7267311e2d0 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.007514 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.009496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.011831 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.012606 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.013512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.013786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] PATH_INFO: `/v3/projects/58c95c99512b45e79697ef3d585d1ce4/users/e98a7fef17c9460d93120c8f1b5229d9/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.031085 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c95c99512b45e79697ef3d585d1ce4, user_id=e98a7fef17c9460d93120c8f1b5229d9, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.034748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9d331-4509-4fd5-9dd7-53972beb67ed admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.041368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c64-dfcd-4a81-b34e-0c953b936562 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.048422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.049202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.049481 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.049750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] PATH_INFO: `/v3/projects/5277589b37154f9fbf10ad1de90fd152` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.050718 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1380/2765] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:29 2022] PUT /identity/v3/projects/58c95c99512b45e79697ef3d585d1ce4/users/e98a7fef17c9460d93120c8f1b5229d9/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:30.051612 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5277589b37154f9fbf10ad1de90fd152)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.053777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.061190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.061538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.061940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.091733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] MFA Rules not processed for user `e98a7fef17c9460d93120c8f1b5229d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:30.092953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.105198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5277589b37154f9fbf10ad1de90fd152', 'request_id': 'req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.114287 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5277589b37154f9fbf10ad1de90fd152', 'request_id': 'req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.120323 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5277589b37154f9fbf10ad1de90fd152', 'request_id': 'req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.132111 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] The token cache is being invalidate because project 5277589b37154f9fbf10ad1de90fd152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:30.132382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.133228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.134727 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1386/2766] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:30 2022] DELETE /identity/v3/projects/5277589b37154f9fbf10ad1de90fd152 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:30.138655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.140003 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.162651 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:30.168543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1381/2767] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:30.176978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.178348 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.210943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173108-30e6-42ef-ba1f-edf10bcd6bd8 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.215632 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.216259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.216539 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.216812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] PATH_INFO: `/v3/users/2794607184c2479e883c50faff60c74a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.217956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2794607184c2479e883c50faff60c74a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.220366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.235821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee7202-8ee9-4fa3-8f58-9a690fb9907f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.240053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.240660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.240931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.241198 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.250882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.252596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.262704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1382/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:30.272728 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2794607184c2479e883c50faff60c74a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.281575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2794607184c2479e883c50faff60c74a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.282397 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2794607184c2479e883c50faff60c74a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.283011 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2794607184c2479e883c50faff60c74a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.295620 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-c141ed33-9aa9-4a08-9e62-0333c4c2f5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2794607184c2479e883c50faff60c74a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.309048 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1387/2769] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:30 2022] DELETE /identity/v3/users/2794607184c2479e883c50faff60c74a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:30.620609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.636770 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d5e4-b0be-4fdd-a3b6-70e296a0737d service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.699376 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.700108 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.700388 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.700656 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] PATH_INFO: `/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.701755 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb719aa0fbc45b89dee52e6138e2f94)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.703766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.705249 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:30.753452 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb719aa0fbc45b89dee52e6138e2f94', 'request_id': 'req-d61f8c6b-9e48-4110-a89d-951ad4d24a16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.761603 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb719aa0fbc45b89dee52e6138e2f94', 'request_id': 'req-d61f8c6b-9e48-4110-a89d-951ad4d24a16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.768596 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb719aa0fbc45b89dee52e6138e2f94', 'request_id': 'req-d61f8c6b-9e48-4110-a89d-951ad4d24a16'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.780473 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] The token cache is being invalidate because project 9cb719aa0fbc45b89dee52e6138e2f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:30.780766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.782152 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-d61f8c6b-9e48-4110-a89d-951ad4d24a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:30.783960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1383/2770] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:30 2022] DELETE /identity/v3/projects/9cb719aa0fbc45b89dee52e6138e2f94 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:30.788429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.788709 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.788975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.809495 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:30.810687 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.875683 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1388/2771] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:30.883788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.884073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.884402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.904597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:30.905819 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:30.916569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1384/2772] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:30.920749 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.933483 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94d1e6-015f-4f02-8290-1b381e42c11b None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.939633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.940301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.940600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.940915 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.941475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:30.941779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.943625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:30.962552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1389/2773] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:30.967650 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:30.982038 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9162-d315-4693-b088-ad14e56bf228 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:30.987764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:30.988409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:30.988694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:30.988970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:30.989648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:30.991847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.020157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1385/2774] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:30 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:31.024341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.035502 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e309115-1e31-46f6-867d-8d53fd8681d0 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.060755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:31.101335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.101943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.102224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.102498 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.103132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.105266 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.128212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1390/2775] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:31 2022] POST /identity/v3/users => generated 278 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:31.132444 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.143593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87f457-ad9d-4b64-99de-f5167b1aae76 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.148176 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.148764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.149041 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.149313 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.149971 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.151602 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.162164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1386/2776] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:31.166068 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.176633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f5bb-b3b7-4273-b552-acf0eaff111d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.181418 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.182012 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.182288 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.182557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.183219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.184816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fb897-bc6b-431a-b895-6f8c246a5601 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.195501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1391/2777] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:31.199496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.209852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754c4ac-c880-45e1-b565-1b0ce4126eaa admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.214502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.215142 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.215418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.215719 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] PATH_INFO: `/v3/projects/86dd6409d1c84ff58b06b08097dd772e/users/94dc4e98954242b0b58579aeb2066324/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.231128 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dd6409d1c84ff58b06b08097dd772e, user_id=94dc4e98954242b0b58579aeb2066324, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.233897 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.247404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1387/2778] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:31 2022] PUT /identity/v3/projects/86dd6409d1c84ff58b06b08097dd772e/users/94dc4e98954242b0b58579aeb2066324/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:31.257597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.257906 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.258205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.287381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] MFA Rules not processed for user `94dc4e98954242b0b58579aeb2066324`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:31.288649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:31.356615 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1392/2779] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:31.362065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.426977 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea446f-b66e-4c4f-b8bf-5092189d7113 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.431717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.432312 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.432643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.432914 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.433563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.435511 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.461265 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1388/2780] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:31 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:31.465464 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.477935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c268cd7-aeca-44fb-b76e-74b8cdba4079 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.534329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.534939 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.535216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.535508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.536149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.538103 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.561327 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1393/2781] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:31 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:31.564835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.575057 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3916-68b8-4fe1-85ee-3c3a920e955f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.579727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.580321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.580598 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.580866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.581497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.583088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.588404 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:31.598986 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1389/2782] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:31.600543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.611575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17ea6-6031-4655-b457-6353d9b37210 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.616239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.617084 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.617180 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.617414 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] PATH_INFO: `/v3/projects/05200e0770564fb4beab4e7404ff263d/users/fa56f05e7f3a4e5cb48b928c6bf82c41/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.632656 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=05200e0770564fb4beab4e7404ff263d, user_id=fa56f05e7f3a4e5cb48b928c6bf82c41, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.640216 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.649909 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:31.655367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1394/2783] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:31 2022] PUT /identity/v3/projects/05200e0770564fb4beab4e7404ff263d/users/fa56f05e7f3a4e5cb48b928c6bf82c41/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:31.659799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.670012 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ac0d6-e39d-4946-b943-ebe6d06838b3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.731887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.732500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.732780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.733051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.733695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.735887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2799214-adb8-47ae-bf28-47ac6d67ca3a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.746064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1390/2784] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:31.750904 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.761242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09095d-4cd3-4310-87e3-7bcb8c6c9cea admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.766513 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.767167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.767451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.767872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] PATH_INFO: `/v3/projects/05200e0770564fb4beab4e7404ff263d/users/fa56f05e7f3a4e5cb48b928c6bf82c41/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.769816 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05200e0770564fb4beab4e7404ff263d, user_id=fa56f05e7f3a4e5cb48b928c6bf82c41, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:31.772666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:31.785986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1395/2785] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:31 2022] PUT /identity/v3/projects/05200e0770564fb4beab4e7404ff263d/users/fa56f05e7f3a4e5cb48b928c6bf82c41/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:31.795980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.796191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.797141 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:31.828763 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] MFA Rules not processed for user `fa56f05e7f3a4e5cb48b928c6bf82c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:31.830150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:31.899304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1391/2786] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:31.910623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:31.912412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:31.980475 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688d8b6-494c-446f-a88b-6e5c27043b34 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:31.985855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:31.986592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:31.986974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:31.987346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:32.004480 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:32.006054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:32.016591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1396/2787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:32.098457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:32.108423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cde14-9653-46b6-a97b-00961b3acf54 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:32.113494 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:32.114181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:32.114581 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:32.114922 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:32.182421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:32.183978 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bea6d-bc23-4f81-b2f4-715faaba5281 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:32.194550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1392/2788] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:32.854279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:32.855770 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:32.920964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8edb7-b305-4a2d-b027-9f9b66c18d9a service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:32.925701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:32.926636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:32.926912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:32.927183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] PATH_INFO: `/v3/users/e98a7fef17c9460d93120c8f1b5229d9` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:32.928364 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98a7fef17c9460d93120c8f1b5229d9)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:32.930269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:32.990355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98a7fef17c9460d93120c8f1b5229d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:32.997680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98a7fef17c9460d93120c8f1b5229d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:32.998347 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98a7fef17c9460d93120c8f1b5229d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:32.999058 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98a7fef17c9460d93120c8f1b5229d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.011664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98a7fef17c9460d93120c8f1b5229d9'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.024540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1397/2789] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:32 2022] DELETE /identity/v3/users/e98a7fef17c9460d93120c8f1b5229d9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:33.028995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.029478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.029597 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.048779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:33.049966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:33.064501 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:33.111457 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1393/2790] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:33.121124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:33.122519 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:33.133902 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:33.183361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b775e1-2012-4d00-8eb5-b4d409c8e918 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:33.187028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:33.188218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.188569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.188793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.198342 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:33.199895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0a3d-15c3-43dc-9852-bb1c1e553e47 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:33.210685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1398/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:33.561362 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:33.563422 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:33.577178 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11077589-65b3-4675-8af7-223d0b3f163f None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:33.586324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:33.587189 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.588333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.588634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] PATH_INFO: `/v3/projects/58c95c99512b45e79697ef3d585d1ce4` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.589918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c95c99512b45e79697ef3d585d1ce4)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:33.591902 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:33.650868 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c95c99512b45e79697ef3d585d1ce4', 'request_id': 'req-31086b39-b727-4756-9930-4bb512325439'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.659248 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c95c99512b45e79697ef3d585d1ce4', 'request_id': 'req-31086b39-b727-4756-9930-4bb512325439'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.664780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c95c99512b45e79697ef3d585d1ce4', 'request_id': 'req-31086b39-b727-4756-9930-4bb512325439'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.676780 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] The token cache is being invalidate because project 58c95c99512b45e79697ef3d585d1ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:33.677166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.677742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-31086b39-b727-4756-9930-4bb512325439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:33.679224 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1394/2792] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:33 2022] DELETE /identity/v3/projects/58c95c99512b45e79697ef3d585d1ce4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:33.684083 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.684362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.684658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.705534 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:33.706745 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:33.769776 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1399/2793] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:33.777292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.777587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.777913 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.799173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:33.800421 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:33.808734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1395/2794] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:33.812843 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:33.822679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d229b-2006-40d8-b9a5-12f3263e1570 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:33.827307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:33.827964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.828239 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.828515 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.829145 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:33.829442 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:33.831163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:33.843212 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1400/2795] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:33.849566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:33.860786 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591df7a1-d2a7-4904-a4ed-012d2d00d035 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:33.865749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:33.866497 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.866838 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.867173 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.868010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:33.870002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:33.898641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1396/2796] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:33 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:33.902476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:33.913132 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5fee4-a495-4884-b8db-c89b91d4d104 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:33.979716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:33.980336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:33.980642 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:33.980916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:33.981556 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:33.983456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:34.007373 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1401/2797] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:33 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:34.011620 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:34.023199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ab09-6640-44a4-8db1-3bc09f4b0b01 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:34.028350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:34.029030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:34.029616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:34.029616 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:34.032039 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:34.033681 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:34.045064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1397/2798] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:34.049942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:34.066653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b3752-1aad-4663-ab83-e6b6db65674a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:34.071375 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:34.072028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:34.072291 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:34.072564 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:34.073202 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:34.074779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c7a3-3e81-43f0-9254-8148cfc6f03f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:34.085596 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1402/2799] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:34.089967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:34.100292 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc025b-39ea-4cd2-89cc-e959cd784bfe admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:34.104973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:34.105611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:34.105888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:34.106164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] PATH_INFO: `/v3/projects/bbd2e83e630e4eb9875848231d7f5cee/users/506657282d56461fb411125f54d7263e/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:34.121088 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd2e83e630e4eb9875848231d7f5cee, user_id=506657282d56461fb411125f54d7263e, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:34.123762 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:34.137752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1398/2800] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:34 2022] PUT /identity/v3/projects/bbd2e83e630e4eb9875848231d7f5cee/users/506657282d56461fb411125f54d7263e/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:34.204022 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:34.204225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:34.204478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:34.232510 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] MFA Rules not processed for user `506657282d56461fb411125f54d7263e`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:34.233730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:34.239730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:34.301316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1403/2801] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:34.313611 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:34.315331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:34.360865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:34.376213 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314c69-d679-4696-8817-f86d22fd469a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:34.379954 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:34.380607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:34.380884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:34.381153 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:34.389369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:34.390848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be20d3-04f0-4372-abda-bd9bb2ffa384 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:34.399550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1399/2802] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:38.444739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:38.446208 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.533222 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da612-9c69-4576-b4ac-a584efb61359 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:38.539073 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:38.539826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:38.540164 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:38.540497 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] PATH_INFO: `/v3/users/b94cb202d7634a71b1215830bafaca79` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:38.541849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94cb202d7634a71b1215830bafaca79)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:38.543950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:38.592260 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94cb202d7634a71b1215830bafaca79'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:38.600546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94cb202d7634a71b1215830bafaca79'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:38.601163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94cb202d7634a71b1215830bafaca79'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:38.601772 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94cb202d7634a71b1215830bafaca79'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:38.614329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94cb202d7634a71b1215830bafaca79'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:38.627149 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1404/2803] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:38 2022] DELETE /identity/v3/users/b94cb202d7634a71b1215830bafaca79 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:38.631672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:38.632143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:38.632257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:38.652370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:38.653574 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.711920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1400/2804] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:38.722472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:38.723928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:38.755001 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:38.786141 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0459d49-1cca-4f4f-8ffc-b61666a56bcc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:38.789874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:38.790478 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:38.790754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:38.791026 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:38.801592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:38.803031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:38.813246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1405/2805] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:39.108308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:39.110418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:39.123299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc73a1-5593-46ec-bdca-67b867135335 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:39.131052 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:39.132035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:39.132367 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:39.132714 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] PATH_INFO: `/v3/projects/0b5a95119d1d4d5c81fcc447ac125df1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:39.142891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5a95119d1d4d5c81fcc447ac125df1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:39.144882 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:39.201863 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5a95119d1d4d5c81fcc447ac125df1', 'request_id': 'req-4a8e8c22-670d-44c5-8338-d813c72f9952'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.217283 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5a95119d1d4d5c81fcc447ac125df1', 'request_id': 'req-4a8e8c22-670d-44c5-8338-d813c72f9952'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.224836 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5a95119d1d4d5c81fcc447ac125df1', 'request_id': 'req-4a8e8c22-670d-44c5-8338-d813c72f9952'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.237525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] The token cache is being invalidate because project 0b5a95119d1d4d5c81fcc447ac125df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:39.237875 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.238528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-4a8e8c22-670d-44c5-8338-d813c72f9952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.240071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1401/2806] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:39 2022] DELETE /identity/v3/projects/0b5a95119d1d4d5c81fcc447ac125df1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:39.428259 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:39.429976 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:39.444682 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9ee4f-7511-462c-ac48-3560d5d8d292 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:39.509059 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:39.509739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:39.509979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:39.510245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] PATH_INFO: `/v3/users/506657282d56461fb411125f54d7263e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:39.511380 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=506657282d56461fb411125f54d7263e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:39.513311 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:39.564368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506657282d56461fb411125f54d7263e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.571577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506657282d56461fb411125f54d7263e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.572649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506657282d56461fb411125f54d7263e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.573265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506657282d56461fb411125f54d7263e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.586096 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506657282d56461fb411125f54d7263e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:39.598416 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1406/2807] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:39 2022] DELETE /identity/v3/users/506657282d56461fb411125f54d7263e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:39.602846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:39.603135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:39.603419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:39.622191 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:39.623399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:39.683502 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1402/2808] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:39.693923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:39.695320 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:39.749458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:39.753624 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d90ea2-9f62-481f-be54-90a9ef259c93 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:39.758950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:39.759793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:39.760242 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:39.760673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:39.769764 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:39.771163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747989b6-c2e0-4152-802e-1204493888ae service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:39.780470 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1407/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:40.058073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.059951 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:40.072795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a6c55-1386-47eb-85ba-68d7a74e0252 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.080593 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.081239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.081518 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.081790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] PATH_INFO: `/v3/projects/bbd2e83e630e4eb9875848231d7f5cee` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.082961 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd2e83e630e4eb9875848231d7f5cee)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.085051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.086797 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:40.134277 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd2e83e630e4eb9875848231d7f5cee', 'request_id': 'req-81da49ce-a90b-4994-8dd8-7aad01c72771'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:40.142321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd2e83e630e4eb9875848231d7f5cee', 'request_id': 'req-81da49ce-a90b-4994-8dd8-7aad01c72771'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:40.148766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd2e83e630e4eb9875848231d7f5cee', 'request_id': 'req-81da49ce-a90b-4994-8dd8-7aad01c72771'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:40.161552 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] The token cache is being invalidate because project bbd2e83e630e4eb9875848231d7f5cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:40.161842 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:40.163644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-81da49ce-a90b-4994-8dd8-7aad01c72771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:40.164246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1403/2810] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:40 2022] DELETE /identity/v3/projects/bbd2e83e630e4eb9875848231d7f5cee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:40.169243 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.169526 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.169799 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.189595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:40.190716 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:40.251338 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1408/2811] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:40.259375 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.259673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.259942 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.284609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:40.285890 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:40.293982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1404/2812] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:40.298458 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.308592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969888b-d78e-4fef-b756-ecdce50f4895 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.314334 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.314767 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.315045 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.315319 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.315987 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:40.316290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.317975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.330822 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1409/2813] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:40.335208 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.345839 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0976-e246-467a-bfca-46ee879b23ac None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.351443 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.352069 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.352343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.352688 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.353230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.355127 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.387044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1405/2814] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:40 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:40.388421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.400125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a410ef-c019-4734-83ac-287419376d08 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.464771 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.465371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.465648 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.465916 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.466543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.468523 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.497055 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1410/2815] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:40 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:40.498282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.509648 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0808a0-ded4-43de-8155-e65f1536f54b admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.515799 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.521401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.521401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.521401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.521401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.521401 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.544343 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1406/2816] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:40.544975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.557653 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59561bb9-2bfb-4ba1-89c8-81ae84ed12bf admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.563163 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.563985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.564337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.564966 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.566130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.568240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc7f4-d1b9-4abb-9aed-4054d5678c57 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.586673 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1411/2817] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:40.587999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.600703 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58db6ac-432e-4cfd-a8ef-d8c6331624df admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.605973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.607000 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.607357 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.607733 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] PATH_INFO: `/v3/projects/9ca2dda4b668401f8389925c7fc8f84b/users/4a3f3e6760d74fd4a606645a1b59cef6/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.625369 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca2dda4b668401f8389925c7fc8f84b, user_id=4a3f3e6760d74fd4a606645a1b59cef6, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.628054 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.646351 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1407/2818] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:40 2022] PUT /identity/v3/projects/9ca2dda4b668401f8389925c7fc8f84b/users/4a3f3e6760d74fd4a606645a1b59cef6/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:40.651667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79785d-919e-483f-b33f-eb24d0ec7f19 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.651947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79785d-919e-483f-b33f-eb24d0ec7f19 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.652214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79785d-919e-483f-b33f-eb24d0ec7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.672135 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-6f79785d-919e-483f-b33f-eb24d0ec7f19 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:40.673473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-6f79785d-919e-483f-b33f-eb24d0ec7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:40.723429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:40.733692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1412/2819] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:40.743672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:40.745402 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:40.804758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e94ae7-14e6-4cd3-90ae-e8185bbcf60f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:40.808600 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:40.809197 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:40.809469 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:40.809735 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:40.819715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:40.821135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:40.831516 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1408/2820] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:45.077905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.078421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.078538 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.109795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] MFA Rules not processed for user `4a3f3e6760d74fd4a606645a1b59cef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:45.111143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:45.211094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1413/2821] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:45.216904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.230903 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e45c61-5f75-4450-bba5-cc7a29b3f407 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.241094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.244424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.244956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.245232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.245905 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.247854 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.289583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1409/2822] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:45.290713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.310935 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d08488-67aa-4725-9dbe-fc9ff6672f05 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.371643 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.372245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.372524 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.372794 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.373424 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.375362 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.396603 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1414/2823] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:45.400545 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.411409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b83e63-c113-47a7-ac89-f5307890ebfe admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.416081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.416746 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.417028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.417306 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.417941 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.419588 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.420857 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:45.433474 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1410/2824] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:45.437872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.447907 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b866d42-b826-4121-9962-52205a46616b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.453779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.453946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.454157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.454435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] PATH_INFO: `/v3/projects/1dbc44155fab4b9fbdde47d15d92378d/users/3287c87986ff4461a237f50f7dbdbb70/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.469783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbc44155fab4b9fbdde47d15d92378d, user_id=3287c87986ff4461a237f50f7dbdbb70, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.472453 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.486154 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1415/2825] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:45 2022] PUT /identity/v3/projects/1dbc44155fab4b9fbdde47d15d92378d/users/3287c87986ff4461a237f50f7dbdbb70/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:45.490110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.500633 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e5de1-72ce-4da5-be8b-11c3710cce1a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.565403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.566018 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.566294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.566563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.567199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.568884 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.579385 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1411/2826] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:45.583576 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:45.593853 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7524e-ac4f-4470-b421-340eb161dead admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:45.598738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:45.599376 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.599692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.599964 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] PATH_INFO: `/v3/projects/1dbc44155fab4b9fbdde47d15d92378d/users/3287c87986ff4461a237f50f7dbdbb70/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.601861 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbc44155fab4b9fbdde47d15d92378d, user_id=3287c87986ff4461a237f50f7dbdbb70, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:45.604547 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad929f-b578-4b6a-b8f1-4384c745af4b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:45.615783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1416/2827] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:45 2022] PUT /identity/v3/projects/1dbc44155fab4b9fbdde47d15d92378d/users/3287c87986ff4461a237f50f7dbdbb70/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:47.611691 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:47.613538 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:47.630758 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29bb8-defe-476a-a33e-ad9be74c0043 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:47.706122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:47.707034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:47.707764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:47.708044 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] PATH_INFO: `/v3/users/94dc4e98954242b0b58579aeb2066324` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:47.709453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dc4e98954242b0b58579aeb2066324)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:47.711899 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:47.766779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dc4e98954242b0b58579aeb2066324'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:47.776723 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dc4e98954242b0b58579aeb2066324'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:47.777466 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dc4e98954242b0b58579aeb2066324'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:47.778520 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dc4e98954242b0b58579aeb2066324'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:47.786236 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dc4e98954242b0b58579aeb2066324'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:47.810389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1412/2828] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:47 2022] DELETE /identity/v3/users/94dc4e98954242b0b58579aeb2066324 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:47.815678 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:47.816961 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:47.818186 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:47.849803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:47.851634 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:47.933107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:47.976505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1417/2829] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:47.988790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:47.990424 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:48.014446 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:48.091180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd470-cd83-4df0-8fcc-f41c268f53d5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:48.096071 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:48.096982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:48.097461 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:48.097938 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:48.109883 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:48.113410 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:48.138222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1413/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:48.607182 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:48.608459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:48.627429 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6ce5e-6304-4aa8-a1f9-cabee0dbb52f None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:48.643981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:48.644701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:48.644983 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:48.645252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] PATH_INFO: `/v3/projects/86dd6409d1c84ff58b06b08097dd772e` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:48.648219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dd6409d1c84ff58b06b08097dd772e)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:48.650828 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:48.768521 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dd6409d1c84ff58b06b08097dd772e', 'request_id': 'req-caf09386-1d4c-4563-accd-6198a7dcca06'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:48.785569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dd6409d1c84ff58b06b08097dd772e', 'request_id': 'req-caf09386-1d4c-4563-accd-6198a7dcca06'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:48.801294 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dd6409d1c84ff58b06b08097dd772e', 'request_id': 'req-caf09386-1d4c-4563-accd-6198a7dcca06'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:48.828887 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] The token cache is being invalidate because project 86dd6409d1c84ff58b06b08097dd772e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:48.830258 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:48.831167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:48.836178 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1418/2831] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:48 2022] DELETE /identity/v3/projects/86dd6409d1c84ff58b06b08097dd772e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:48.837062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:48.853526 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127be4c-8bd9-452c-a4e4-5e057689084f service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:49.039736 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:49.040378 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.040647 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.040920 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] PATH_INFO: `/v3/users/fa56f05e7f3a4e5cb48b928c6bf82c41` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.045541 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa56f05e7f3a4e5cb48b928c6bf82c41)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:49.048840 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:49.179129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa56f05e7f3a4e5cb48b928c6bf82c41'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.197910 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa56f05e7f3a4e5cb48b928c6bf82c41'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.198169 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa56f05e7f3a4e5cb48b928c6bf82c41'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.198885 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa56f05e7f3a4e5cb48b928c6bf82c41'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.214011 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-bf77766f-9e87-49a2-8602-21986e233f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa56f05e7f3a4e5cb48b928c6bf82c41'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:49.255116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1414/2832] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:48 2022] DELETE /identity/v3/users/fa56f05e7f3a4e5cb48b928c6bf82c41 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:49.793228 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:49.794849 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:49.820463 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf09386-1d4c-4563-accd-6198a7dcca06 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:49.959649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:49.965586 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.965874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.966672 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] PATH_INFO: `/v3/projects/05200e0770564fb4beab4e7404ff263d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.969183 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05200e0770564fb4beab4e7404ff263d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:49.972490 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.078684 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05200e0770564fb4beab4e7404ff263d', 'request_id': 'req-2255568e-563c-421f-9c19-8c31bbb67a1f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:50.097399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05200e0770564fb4beab4e7404ff263d', 'request_id': 'req-2255568e-563c-421f-9c19-8c31bbb67a1f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:50.106924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05200e0770564fb4beab4e7404ff263d', 'request_id': 'req-2255568e-563c-421f-9c19-8c31bbb67a1f'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:50.108061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.128840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] The token cache is being invalidate because project 05200e0770564fb4beab4e7404ff263d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:50.129372 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:50.130329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-2255568e-563c-421f-9c19-8c31bbb67a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:50.136226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1419/2833] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:49 2022] DELETE /identity/v3/projects/05200e0770564fb4beab4e7404ff263d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:50.137900 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.138382 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.138482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.188026 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:50.191904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.236744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.304539 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1415/2834] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:50.312511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.312813 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.313269 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.355296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:50.356950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.372176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1420/2835] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:50.379973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.392969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d2b1c-bb96-473f-ac44-cf975193496e None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.400260 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.401029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.401322 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.401599 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.402257 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:50.402566 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.404247 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.421930 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1416/2836] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:50.423138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.434094 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde0efe-2050-470a-89fe-7f765fb47eb3 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.441421 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.442155 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.442496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.442857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.443580 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.445569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3a3bf-c802-433d-969c-f8592fab8468 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.490703 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1421/2837] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:50.494608 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.517826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.517826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.518129 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd7c5-ae74-4746-868e-da510d284346 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.518219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.560633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] MFA Rules not processed for user `3287c87986ff4461a237f50f7dbdbb70`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:50.562633 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.616359 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.616993 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.617279 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.617553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.618745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.620848 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.645985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1417/2838] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:50.649660 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.660464 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ab1c-e6f8-4ae1-886b-3942a7d8371e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.676752 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.677387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.677667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.677970 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.678609 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.681181 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.695846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1418/2839] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:50.699891 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.726659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1422/2840] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:50.745701 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.747317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed0c7-b592-49ea-806e-9487d6a75b93 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.747911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.753379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.754007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.754286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.754584 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.755595 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.757386 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.770631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1419/2841] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:13:50.781679 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:50.792662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1932ca-3850-4f24-8d37-d3e4bcff4a7f admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.799095 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.799887 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.800170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.800936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] PATH_INFO: `/v3/projects/3f0b44f893d443318cf931b01b75c379/users/521b7fec204740a9b25f7e7fd7b3f4ac/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.823605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0b44f893d443318cf931b01b75c379, user_id=521b7fec204740a9b25f7e7fd7b3f4ac, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:50.829233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a5681-cd10-432c-a897-1f847a5f6163 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:50.856190 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1420/2842] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:50 2022] PUT /identity/v3/projects/3f0b44f893d443318cf931b01b75c379/users/521b7fec204740a9b25f7e7fd7b3f4ac/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:50.868288 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.868661 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.869002 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.873532 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab26f7-9ce0-411a-932b-236e551827d0 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:50.910742 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] MFA Rules not processed for user `521b7fec204740a9b25f7e7fd7b3f4ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:50.912083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:50.947128 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.982331 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:50.983224 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:50.990226 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:50.990975 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:50.991496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:50.994873 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:51.006559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1421/2843] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:51.007409 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.088500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3802040-5e2a-4601-b93b-3434b5eeb2f2 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.094513 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.095144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.095418 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.095734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.096381 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.098320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.099654 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.101329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.123569 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1423/2844] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:51.135119 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1422/2845] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:51.138712 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.150722 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962bb5f-31af-4ac6-8100-3b228482bd46 service nova] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.245973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.246892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.246892 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.247102 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.247797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.251505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.286457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1424/2846] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:51.290888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.303561 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f13671-eb23-46b1-b00c-f492f2a6004a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.313036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.313821 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.314104 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.314512 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.315864 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.317544 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.330791 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1423/2847] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:51.334945 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.346496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6f580-8815-4c72-a7b4-d5ad42b63cd3 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.352297 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.352912 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.353176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.353471 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.354381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.356655 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158739af-80ac-4927-b6db-1b927e449ac0 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.374725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1425/2848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:51.375980 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.386158 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade753c5-1be0-45a6-8563-637fa7d9ad63 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.392904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.393570 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.393853 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.394637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] PATH_INFO: `/v3/projects/5a65ff79bc854e78a0dc00f91dc2736f/users/d581ab535e4c4596b42d702bb3e8e262/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.410436 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a65ff79bc854e78a0dc00f91dc2736f, user_id=d581ab535e4c4596b42d702bb3e8e262, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.413170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.426517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1424/2849] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:51 2022] PUT /identity/v3/projects/5a65ff79bc854e78a0dc00f91dc2736f/users/d581ab535e4c4596b42d702bb3e8e262/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:51.436472 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.436894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.437379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.469078 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] MFA Rules not processed for user `d581ab535e4c4596b42d702bb3e8e262`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:51.470290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:51.568591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:51.586645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1426/2850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:51.591091 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.687668 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850ed13-fdee-4263-9712-5f14c15a83bd admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.693239 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.693963 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.694299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.695076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.695330 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.697354 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.731577 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1425/2851] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:51.736355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.748176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43597f55-3fe8-482a-9e62-e951c8f41476 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.837830 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.838465 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.838744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.839008 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.839744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.843307 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.869783 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1427/2852] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:13:51.873803 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.886020 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5caad-18b6-4f15-baff-98da72856f75 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.892004 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.892734 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.893014 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.893287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.893934 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.895579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.911550 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1426/2853] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:51.915066 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:51.926875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc4566-544e-4476-87b5-8566f539967c admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:51.933151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:51.933900 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.934244 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.934595 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] PATH_INFO: `/v3/projects/c0d258cd9a04460c810ad2f76a632d87/users/fe118f1cecc5482facb9f93fd0cb148a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.966184 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d258cd9a04460c810ad2f76a632d87, user_id=fe118f1cecc5482facb9f93fd0cb148a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:51.966520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:51.982997 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1428/2854] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:51 2022] PUT /identity/v3/projects/c0d258cd9a04460c810ad2f76a632d87/users/fe118f1cecc5482facb9f93fd0cb148a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:51.987764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.001122 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28329b-2c3d-4853-a630-811580ee1d12 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.014195 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:52.069976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.070589 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.070866 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.071134 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.071805 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.073529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a1355-a4de-4e66-9f83-3e4b9df88435 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.085663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1427/2855] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:52.090639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.105325 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d293355-e7ac-4893-8abd-c9373a1b01f2 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.116270 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.117739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.117946 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.118108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] PATH_INFO: `/v3/projects/c0d258cd9a04460c810ad2f76a632d87/users/fe118f1cecc5482facb9f93fd0cb148a/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.121522 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d258cd9a04460c810ad2f76a632d87, user_id=fe118f1cecc5482facb9f93fd0cb148a, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.128408 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.137637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1429/2856] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:52 2022] PUT /identity/v3/projects/c0d258cd9a04460c810ad2f76a632d87/users/fe118f1cecc5482facb9f93fd0cb148a/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:52.148406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65634-46bc-4f33-a3c5-813353b1dc67 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.149094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65634-46bc-4f33-a3c5-813353b1dc67 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.149414 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65634-46bc-4f33-a3c5-813353b1dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.182992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-23f65634-46bc-4f33-a3c5-813353b1dc67 None None] MFA Rules not processed for user `fe118f1cecc5482facb9f93fd0cb148a`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:52.184360 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-23f65634-46bc-4f33-a3c5-813353b1dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.266405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1428/2857] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:52.278240 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.281351 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.285788 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.286037 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.286298 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.306992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] MFA Rules not processed for user `4a3f3e6760d74fd4a606645a1b59cef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:52.308235 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.355734 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2c9d9-9fe6-4611-b2e4-da6df18156d5 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.359555 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.360061 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.360336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.360599 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.370298 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.370790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1429/2858] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:52.371750 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.383016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1430/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:52.428144 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.439815 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a86630-9e9a-4d38-81fa-90b064491377 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.443874 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.444490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.444768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.445045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.492837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=100 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:52.507272 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.508876 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b0f10-284f-43ea-b10f-4f009607d502 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.519185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1430/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:55.588991 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.661903 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:55.739875 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67a5ef-79aa-4b0b-a51a-ae9cc78926a2 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:55.744878 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:55.745587 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.746042 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.746468 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] PATH_INFO: `/v3/users/521b7fec204740a9b25f7e7fd7b3f4ac` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.747951 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=521b7fec204740a9b25f7e7fd7b3f4ac)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:55.751188 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:55.803174 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521b7fec204740a9b25f7e7fd7b3f4ac'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:55.812549 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521b7fec204740a9b25f7e7fd7b3f4ac'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:55.813201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521b7fec204740a9b25f7e7fd7b3f4ac'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:55.813832 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521b7fec204740a9b25f7e7fd7b3f4ac'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:55.826054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521b7fec204740a9b25f7e7fd7b3f4ac'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:55.839329 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1431/2861] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:55 2022] DELETE /identity/v3/users/521b7fec204740a9b25f7e7fd7b3f4ac => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:55.844081 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.844673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.844673 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.898110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:55.899311 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.961553 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1431/2862] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:55.972979 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.974405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:56.063133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659143-4a2b-4c1a-8464-e960e7d0d48d admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:56.066800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:56.067560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:56.067694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:56.067956 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:56.077384 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:56.079063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:56.090050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1432/2863] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:56.373682 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:56.376372 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:56.390768 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf8a9-bd71-41be-80f6-c0e5656d7b12 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:56.396024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:56.396694 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:56.396973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:56.397246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] PATH_INFO: `/v3/projects/3f0b44f893d443318cf931b01b75c379` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:56.398506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0b44f893d443318cf931b01b75c379)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:56.400663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:56.452022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0b44f893d443318cf931b01b75c379', 'request_id': 'req-26018878-17e5-4582-b677-d2da204bceef'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.460605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0b44f893d443318cf931b01b75c379', 'request_id': 'req-26018878-17e5-4582-b677-d2da204bceef'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.466662 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0b44f893d443318cf931b01b75c379', 'request_id': 'req-26018878-17e5-4582-b677-d2da204bceef'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.477845 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] The token cache is being invalidate because project 3f0b44f893d443318cf931b01b75c379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:56.478132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.478843 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.480823 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1432/2864] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:56 2022] DELETE /identity/v3/projects/3f0b44f893d443318cf931b01b75c379 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:56.486797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:56.495488 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfe17a-4791-4c56-87da-4a55ea0593a1 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:56.505412 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:56.559931 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:56.560551 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:56.560825 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:56.561089 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] PATH_INFO: `/v3/users/d581ab535e4c4596b42d702bb3e8e262` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:56.562942 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d581ab535e4c4596b42d702bb3e8e262)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:56.564872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:56.613965 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd581ab535e4c4596b42d702bb3e8e262'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.622143 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd581ab535e4c4596b42d702bb3e8e262'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.623121 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd581ab535e4c4596b42d702bb3e8e262'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.623812 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd581ab535e4c4596b42d702bb3e8e262'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.636943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd581ab535e4c4596b42d702bb3e8e262'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:56.650246 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1433/2865] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:56 2022] DELETE /identity/v3/users/d581ab535e4c4596b42d702bb3e8e262 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:56.949739 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:56.951220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:56.966110 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26018878-17e5-4582-b677-d2da204bceef admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:57.011918 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:57.033641 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:57.034280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.034562 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.034837 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] PATH_INFO: `/v3/projects/5a65ff79bc854e78a0dc00f91dc2736f` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.035992 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a65ff79bc854e78a0dc00f91dc2736f)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:57.037953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:57.087663 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a65ff79bc854e78a0dc00f91dc2736f', 'request_id': 'req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.095672 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a65ff79bc854e78a0dc00f91dc2736f', 'request_id': 'req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.101565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a65ff79bc854e78a0dc00f91dc2736f', 'request_id': 'req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.116405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] The token cache is being invalidate because project 5a65ff79bc854e78a0dc00f91dc2736f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:57.116697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.117363 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.119083 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1433/2866] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:56 2022] DELETE /identity/v3/projects/5a65ff79bc854e78a0dc00f91dc2736f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:57.123129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:57.125426 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:57.139337 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066253e-ce33-45a4-a9a5-1ea363de2885 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:57.200341 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:57.200972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.201253 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.201525 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] PATH_INFO: `/v3/users/fe118f1cecc5482facb9f93fd0cb148a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.203381 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe118f1cecc5482facb9f93fd0cb148a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:57.205322 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:57.245237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:57.257496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe118f1cecc5482facb9f93fd0cb148a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.265157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe118f1cecc5482facb9f93fd0cb148a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.266105 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe118f1cecc5482facb9f93fd0cb148a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.266740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe118f1cecc5482facb9f93fd0cb148a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.279570 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-d214039c-72df-468d-a5f8-3028c411df5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe118f1cecc5482facb9f93fd0cb148a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.292674 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1434/2867] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:57 2022] DELETE /identity/v3/users/fe118f1cecc5482facb9f93fd0cb148a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:57.581167 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:57.582873 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:57.599355 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce875-55cd-4c6c-bb74-d721ef1fa52c admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:57.665972 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:57.666707 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.666985 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.667282 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] PATH_INFO: `/v3/projects/c0d258cd9a04460c810ad2f76a632d87` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.668479 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d258cd9a04460c810ad2f76a632d87)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:57.670361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:57.718690 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d258cd9a04460c810ad2f76a632d87', 'request_id': 'req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.726406 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d258cd9a04460c810ad2f76a632d87', 'request_id': 'req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.732180 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d258cd9a04460c810ad2f76a632d87', 'request_id': 'req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.740862 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:57.745893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] The token cache is being invalidate because project c0d258cd9a04460c810ad2f76a632d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:13:57.746737 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.747901 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-0d5643c9-6b5d-48bc-bb5e-126ac7b258e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:57.749715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1434/2868] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:13:57 2022] DELETE /identity/v3/projects/c0d258cd9a04460c810ad2f76a632d87 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:57.755739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.756250 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.756361 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.807366 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:57.808602 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:57.869978 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1435/2869] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:57.880032 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.880405 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.880659 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.900933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:57.902327 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:57.910940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1435/2870] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:57.915398 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:57.926998 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474be48-662e-4f89-983e-f5a3d86e3883 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:57.931938 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:57.932552 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.932833 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.933100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.933755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:13:57.934054 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:57.935659 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:57.947779 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1436/2871] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:13:57.952761 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:57.963317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9599d0-47b8-4ea8-82f2-65232f737364 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:57.969670 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:57.970270 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:57.970543 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:57.970809 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:57.971441 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:57.973353 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.001605 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1436/2872] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:57 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:58.006548 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.018378 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0cae3-06c0-4b78-85c7-36b837e8c738 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.089173 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.089795 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.090108 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.090383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.091153 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.093371 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.116476 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1437/2873] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:58.120572 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.131745 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc16706-2f67-484a-8ca2-fe61741547cc admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.136358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.136953 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.137231 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.137503 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.138135 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.139960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.151139 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1437/2874] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:58.154565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.161279 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:58.165346 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc52e5-2a14-4ad6-b4b3-9bf5b70b84ff admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.176063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.176857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.177201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.177479 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.178125 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.179739 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72c2ba-ce9b-4465-940d-cb71ae45e613 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.197787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1438/2875] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:58.201969 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.212960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7238cb-02b0-42a0-b2b7-6ca95854e4f1 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.217658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.218727 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.219022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.219299 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] PATH_INFO: `/v3/projects/b1c63ff6e2c44df68a42085c28f7037b/users/3f8f3241c45846b6a314eccbc3e30e09/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.235658 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c63ff6e2c44df68a42085c28f7037b, user_id=3f8f3241c45846b6a314eccbc3e30e09, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.238335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.253440 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1438/2876] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:58 2022] PUT /identity/v3/projects/b1c63ff6e2c44df68a42085c28f7037b/users/3f8f3241c45846b6a314eccbc3e30e09/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:58.265130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.265550 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.266077 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.296161 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] MFA Rules not processed for user `3f8f3241c45846b6a314eccbc3e30e09`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:58.297438 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:58.380276 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1439/2877] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:58.384959 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.453280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e45488-0220-4a71-9d8c-1212facc64ac admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.458149 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.458749 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.459023 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.459319 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.459966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.461850 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.490460 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1439/2878] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:58.494729 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.506507 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cd4e3-5a4f-4d63-aea5-210dbdd2eef2 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.568093 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.568698 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.568972 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.569237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.569857 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.571778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.595658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1440/2879] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:13:58.599784 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.610759 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfda7e-5c3a-4b08-ba13-3aa18a571d3e admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.615631 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.616246 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.616536 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.616811 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.617455 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.619064 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.631940 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1440/2880] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:58.636511 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.648301 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826062f-b079-4510-8ea7-a14f5f287d6a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.653113 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.653787 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.654072 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.654345 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] PATH_INFO: `/v3/projects/2d6c7a0607c04b6c9c78657f73944067/users/92df79e169034849aa688aa101e6f3b1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.671713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6c7a0607c04b6c9c78657f73944067, user_id=92df79e169034849aa688aa101e6f3b1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.674663 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.691671 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1441/2881] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:58 2022] PUT /identity/v3/projects/2d6c7a0607c04b6c9c78657f73944067/users/92df79e169034849aa688aa101e6f3b1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:58.696304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.710233 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10b7c-2cdb-4f69-870f-058adc051274 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.774517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.774517 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.774847 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.774967 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.775634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.777237 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1246274-d296-4d40-821c-583265e602fc admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.788921 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1441/2882] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:58.793151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.806021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aaf0f-2c1c-42b8-a47c-5c31168e6164 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.810680 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.811331 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.812645 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.812872 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] PATH_INFO: `/v3/projects/2d6c7a0607c04b6c9c78657f73944067/users/92df79e169034849aa688aa101e6f3b1/roles/9bb543c39d404aa2ad93eb8abd213cee` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.815324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6c7a0607c04b6c9c78657f73944067, user_id=92df79e169034849aa688aa101e6f3b1, role_id=9bb543c39d404aa2ad93eb8abd213cee)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.817963 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.829004 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1442/2883] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:13:58 2022] PUT /identity/v3/projects/2d6c7a0607c04b6c9c78657f73944067/users/92df79e169034849aa688aa101e6f3b1/roles/9bb543c39d404aa2ad93eb8abd213cee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:13:58.839250 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.839563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.839835 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.855080 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:58.871068 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] MFA Rules not processed for user `92df79e169034849aa688aa101e6f3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:58.872384 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:58.943275 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1442/2884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:58.955274 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.957021 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:59.001894 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:59.021638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f0f6-8e82-4f66-acdd-92b5fc854c4b admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:59.025386 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:59.025950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:59.026324 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:59.026591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:59.036543 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:59.037973 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:59.050335 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1443/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:59.143705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:59.154010 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e7b18-63ef-456e-a62f-ed94ca1a6740 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:59.158966 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:59.159612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:59.159911 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:59.160185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:59.225695 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:59.227137 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d68d1-4d00-4bd9-9ba7-2642a2ee083e service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:59.237335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1443/2886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:59.524399 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:59.589737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6ef4-08d0-4820-a571-f68c7aaf74a2 service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:59.594635 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:59.595257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:59.595560 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:59.595826 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] PATH_INFO: `/v3/users/3f8f3241c45846b6a314eccbc3e30e09` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:59.596968 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8f3241c45846b6a314eccbc3e30e09)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:59.599020 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:59.648792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8f3241c45846b6a314eccbc3e30e09'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:59.656565 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8f3241c45846b6a314eccbc3e30e09'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:59.657285 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8f3241c45846b6a314eccbc3e30e09'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:59.657876 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8f3241c45846b6a314eccbc3e30e09'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:59.670685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8f3241c45846b6a314eccbc3e30e09'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:13:59.689167 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1444/2887] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:13:59 2022] DELETE /identity/v3/users/3f8f3241c45846b6a314eccbc3e30e09 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:13:59.693748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:59.694029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:59.694333 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:59.714024 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:59.715228 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:59.775358 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1444/2888] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:59.785508 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:59.786949 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:59.850225 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595941-54a3-43c4-9026-395951d07911 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:59.853974 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:59.854584 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:59.854860 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:59.855133 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:59.865257 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:59.866649 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:59.871575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:59.878422 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1445/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:00.164790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:00.166568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:00.182286 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7752d59-6bf4-4a53-bc6c-8fc51d445388 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:00.189453 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:00.190221 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:00.190652 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:00.190999 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] PATH_INFO: `/v3/projects/b1c63ff6e2c44df68a42085c28f7037b` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:00.192973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c63ff6e2c44df68a42085c28f7037b)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:00.195090 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:00.229463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:00.247841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c63ff6e2c44df68a42085c28f7037b', 'request_id': 'req-f8a2718c-b3e2-455d-9d3b-d6fef557e648'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.256112 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c63ff6e2c44df68a42085c28f7037b', 'request_id': 'req-f8a2718c-b3e2-455d-9d3b-d6fef557e648'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.262094 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c63ff6e2c44df68a42085c28f7037b', 'request_id': 'req-f8a2718c-b3e2-455d-9d3b-d6fef557e648'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.276093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] The token cache is being invalidate because project b1c63ff6e2c44df68a42085c28f7037b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:00.276370 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.277030 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.278607 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1445/2890] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:00 2022] DELETE /identity/v3/projects/b1c63ff6e2c44df68a42085c28f7037b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:14:00.282881 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:00.292723 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92148-35b9-4e34-96c2-d7cb720d63a5 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:00.356755 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:00.357387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:00.357666 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:00.357958 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] PATH_INFO: `/v3/users/92df79e169034849aa688aa101e6f3b1` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:00.359679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92df79e169034849aa688aa101e6f3b1)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:00.361658 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:00.415256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92df79e169034849aa688aa101e6f3b1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.429459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92df79e169034849aa688aa101e6f3b1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.430252 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92df79e169034849aa688aa101e6f3b1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.430895 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92df79e169034849aa688aa101e6f3b1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.447546 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-69459b6a-0b75-4d99-90f0-4048bb8973e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92df79e169034849aa688aa101e6f3b1'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.462947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1446/2891] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:00 2022] DELETE /identity/v3/users/92df79e169034849aa688aa101e6f3b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:00.747308 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:00.749102 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:00.764779 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2718c-b3e2-455d-9d3b-d6fef557e648 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:00.838637 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:00.839304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:00.839623 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:00.839892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] PATH_INFO: `/v3/projects/2d6c7a0607c04b6c9c78657f73944067` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:00.841185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6c7a0607c04b6c9c78657f73944067)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:00.843790 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:00.891437 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6c7a0607c04b6c9c78657f73944067', 'request_id': 'req-97ecb731-4b73-4dcf-817a-fdbddc93411a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.899207 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6c7a0607c04b6c9c78657f73944067', 'request_id': 'req-97ecb731-4b73-4dcf-817a-fdbddc93411a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.905806 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6c7a0607c04b6c9c78657f73944067', 'request_id': 'req-97ecb731-4b73-4dcf-817a-fdbddc93411a'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.917147 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] The token cache is being invalidate because project 2d6c7a0607c04b6c9c78657f73944067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:00.917433 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.918072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-97ecb731-4b73-4dcf-817a-fdbddc93411a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:00.919643 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1446/2892] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:00 2022] DELETE /identity/v3/projects/2d6c7a0607c04b6c9c78657f73944067 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:00.926106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:00.926610 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:00.926841 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:00.947410 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:00.948600 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.011175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1447/2893] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:01.076188 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.076468 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.076740 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.098851 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:01.100072 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.110500 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1447/2894] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:01.115028 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.126081 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eda94-0e2c-4ce0-9d81-f40aa97b6373 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.131198 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.131855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.132130 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.132420 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.136616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81487) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:01.136616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.136616 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.149563 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1448/2895] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:14:01.153705 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.166841 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4b90-2850-4b17-87d2-f5066bd60229 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.171558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.172155 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.172429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.172697 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.173320 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.175253 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.207496 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1448/2896] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:01 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:01.213100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.224451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a8cb-663c-46f8-92c6-6afaa7648ecc admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.228293 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.286937 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.287577 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.287859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.288140 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] PATH_INFO: `/v3/users` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.288784 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.290685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.315197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1449/2897] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:01 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:14:01.319301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.332482 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c09952-6127-478f-9d14-ffff1295d288 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.337559 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.338199 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.338506 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.338802 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.339480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.341097 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.351865 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1449/2898] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:01.356043 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.366685 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ac211-3903-4cfc-9e3c-77c9a40fad58 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.371575 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.372175 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.372457 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.372730 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.373392 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.375738 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04ef6-c696-457d-b2d3-78e3b18f19dd admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.387496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1450/2899] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:01.391928 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.398478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.402674 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431910d-d39d-4330-8bf6-8549abbd4c36 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.409361 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.410324 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.410936 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.411495 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] PATH_INFO: `/v3/projects/b3c070a5e5c344e7b446eebec1cd9f83/users/0413ea266acb44b89c047328aa78bc6d/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.427716 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c070a5e5c344e7b446eebec1cd9f83, user_id=0413ea266acb44b89c047328aa78bc6d, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.430399 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.445093 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1450/2900] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:01 2022] PUT /identity/v3/projects/b3c070a5e5c344e7b446eebec1cd9f83/users/0413ea266acb44b89c047328aa78bc6d/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:01.456356 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.456639 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.456911 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.486313 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] MFA Rules not processed for user `0413ea266acb44b89c047328aa78bc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:01.487592 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.556720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1451/2901] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:01.568273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.570096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.634892 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3c3e-36ce-48b7-b2ec-0c0ca8f76229 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.638504 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.639113 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.639387 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.640073 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.648932 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.650601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.663025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1451/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:03.195211 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:03.196834 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:03.302840 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:03.313740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c437d9-b86f-4689-ade5-a49a6080d933 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:03.321792 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:03.322209 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:03.322492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:03.322923 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:03.324820 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:03.337803 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:03.339617 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d7a7-8ad5-4998-a147-9c87801cada9 service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:03.351754 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1452/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:14:04.953586 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.018350 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6422d1-c963-4fe2-997d-91c6957268c5 service cinder] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.022888 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.023542 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.023827 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.024101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] PATH_INFO: `/v3/users/0413ea266acb44b89c047328aa78bc6d` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.025220 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0413ea266acb44b89c047328aa78bc6d)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.027143 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.073812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0413ea266acb44b89c047328aa78bc6d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.081273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0413ea266acb44b89c047328aa78bc6d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.082051 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0413ea266acb44b89c047328aa78bc6d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.082828 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0413ea266acb44b89c047328aa78bc6d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.090061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0413ea266acb44b89c047328aa78bc6d'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.110525 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1452/2904] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:04 2022] DELETE /identity/v3/users/0413ea266acb44b89c047328aa78bc6d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:05.114936 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.115435 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.115572 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.135263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:05.136590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.199520 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1453/2905] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:05.209273 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.210713 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.216632 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:05.272833 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2e174-5db8-4417-8091-8d40e4024dc5 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.276471 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.277075 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.277368 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.277640 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.287230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.288696 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d57f26-c52b-4fdc-893c-2e4a10b24dd7 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.298601 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1453/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:05.571407 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.572940 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.596214 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8d07a-87a8-450b-a5b9-7dcd98cc1982 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.603886 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.604594 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.604943 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.605282 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] PATH_INFO: `/v3/projects/b3c070a5e5c344e7b446eebec1cd9f83` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.606505 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c070a5e5c344e7b446eebec1cd9f83)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.608947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.662201 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c070a5e5c344e7b446eebec1cd9f83', 'request_id': 'req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.670451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c070a5e5c344e7b446eebec1cd9f83', 'request_id': 'req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.681517 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c070a5e5c344e7b446eebec1cd9f83', 'request_id': 'req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.694901 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] The token cache is being invalidate because project b3c070a5e5c344e7b446eebec1cd9f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:05.695189 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.695859 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-438701d1-1c1e-4159-a3ac-c12e4d6bb63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:05.697350 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1454/2907] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:05 2022] DELETE /identity/v3/projects/b3c070a5e5c344e7b446eebec1cd9f83 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:05.702908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.703217 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.703490 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.726653 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:05.727825 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.789630 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1454/2908] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:05.798880 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.799171 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.799451 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.821213 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:05.822545 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.834720 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1455/2909] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:05.839077 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.849344 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a0098-982e-4be0-b3c2-6ab8bbbc0a38 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.853931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.854533 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.854808 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.855076 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] PATH_INFO: `/v3/domains` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.855744 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:14:05.856043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.857634 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.872664 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1455/2910] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Sep 7 13:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:14:05.877664 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.887050 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dd4d-9813-45d9-8998-4178cc83fc6d None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.892662 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.893265 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.893540 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.893808 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.894433 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.896368 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.940165 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1456/2911] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Sep 7 13:14:05 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:05.947251 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.957098 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37171c1f-6ac6-4490-aa10-f21088ac485a admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:06.017230 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:06.017777 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.018053 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.018927 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] PATH_INFO: `/v3/users` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.019612 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:06.021528 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:06.044535 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1456/2912] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Sep 7 13:14:05 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:14:06.048559 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:06.060069 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58ba70-6240-4779-8f2b-8f9dabb016b1 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:06.065761 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:06.066496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.066780 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.067052 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] PATH_INFO: `/v3/roles` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.067800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:06.069390 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:06.080667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1457/2913] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:06.084569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:06.095534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f93e62-a6e6-42a7-823f-55ad19142992 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:06.100182 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:06.100785 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.101061 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.101329 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.101958 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:06.103579 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864405cc-024b-4212-b3b9-cd1e4fb93283 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:06.117973 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1457/2914] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Sep 7 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:14:06.119296 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:06.130305 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1e3dd-5765-4c54-9f98-d80eb32352db admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:06.135263 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:06.136035 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.136379 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.136737 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] PATH_INFO: `/v3/projects/3fe2cfa0fc504948a31ed2369be6731a/users/69bf5241bb984cdda7ec49910f7c1fe1/roles/d56a4f333035431eb58b79b9117ac64d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.153445 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe2cfa0fc504948a31ed2369be6731a, user_id=69bf5241bb984cdda7ec49910f7c1fe1, role_id=d56a4f333035431eb58b79b9117ac64d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:06.156623 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:06.172104 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1458/2915] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Sep 7 13:14:06 2022] PUT /identity/v3/projects/3fe2cfa0fc504948a31ed2369be6731a/users/69bf5241bb984cdda7ec49910f7c1fe1/roles/d56a4f333035431eb58b79b9117ac64d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:06.177485 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09873c-f726-47ad-a556-b614a02e08f6 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.177852 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09873c-f726-47ad-a556-b614a02e08f6 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.178036 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09873c-f726-47ad-a556-b614a02e08f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.198698 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-af09873c-f726-47ad-a556-b614a02e08f6 None None] MFA Rules not processed for user `a3c66ed18b954814afb1ba80dd0f24ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:06.200403 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-af09873c-f726-47ad-a556-b614a02e08f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:06.206816 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:06.265939 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1458/2916] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:06.276100 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:06.277827 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:06.285777 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:06.355782 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955175-dd76-405d-a267-e2814f67c933 admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:06.360232 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:06.360847 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:06.361126 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:06.361395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:06.371281 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:06.372793 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:06.383917 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1459/2917] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:07.108915 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029c52e-7e9a-4623-ad58-7bada5a45558 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:07.109480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029c52e-7e9a-4623-ad58-7bada5a45558 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:07.109480 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029c52e-7e9a-4623-ad58-7bada5a45558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:07.145028 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-8029c52e-7e9a-4623-ad58-7bada5a45558 None None] MFA Rules not processed for user `69bf5241bb984cdda7ec49910f7c1fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:07.146590 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-8029c52e-7e9a-4623-ad58-7bada5a45558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:07.230946 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1459/2918] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:07.238959 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:07.240447 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:07.308636 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d24578-2ac6-4b5d-81bc-d6459f1cd8b4 service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:07.312899 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c44a2759eab46dbae21ad7eeb96df9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:07.313504 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:07.313990 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:07.314256 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:07.324034 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:07.325459 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:07.335106 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1460/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:08.722568 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:08.723034 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:08.723145 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:08.745564 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] MFA Rules not processed for user `69bf5241bb984cdda7ec49910f7c1fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:08.746767 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:08.754904 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1460/2920] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:13.396713 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:13.399365 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:13.526098 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee1830-04aa-421d-b30a-67ad022e0ecd service cinder] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:13.536031 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '565774033b5d4aaab833757169efb547', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:13.537358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:13.537637 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:13.537905 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:13.539705 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:13.553797 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:13.555387 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5b111-f2a9-4997-a7d8-4dd281a75ace service nova] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:13.566982 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1461/2921] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:16.761982 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:16.763429 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:16.799151 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28624b28-299d-4257-a6b3-85070bf2c8d5 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:16.803101 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:16.803732 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:16.804009 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:16.804278 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:16.805996 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:16.870459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:16.871945 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcc0db-05d2-471b-8436-ee307e179168 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:16.882389 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1461/2922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:14:23.563450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=96 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:24.705831 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:24.706456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:24.706456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:24.726271 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] MFA Rules not processed for user `69bf5241bb984cdda7ec49910f7c1fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:24.727492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:24.734328 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1462/2923] 10.222.0.18 () {58 vars in 958 bytes} [Wed Sep 7 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:26.877764 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=96 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:34.721321 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=3 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:40.428045 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02fed-9209-4c71-85aa-ce7f64eb4539 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:40.428557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02fed-9209-4c71-85aa-ce7f64eb4539 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:40.428557 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff02fed-9209-4c71-85aa-ce7f64eb4539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:40.460043 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-6ff02fed-9209-4c71-85aa-ce7f64eb4539 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:40.461274 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-6ff02fed-9209-4c71-85aa-ce7f64eb4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:40.523893 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1462/2924] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Sep 7 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:40.568129 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:40.569501 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:40.643450 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3feedd-639f-4f69-999f-7c55a5e10324 None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:40.648667 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:40.649277 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:40.649558 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:40.649829 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:40.659064 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:40.660694 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:40.669496 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1463/2925] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:14:50.509644 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=29 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:50.666124 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=32 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:56.135987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.136463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.136463 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.156335 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] MFA Rules not processed for user `0dab0ca4926a45c0a0476bf3599161ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:56.157540 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:56.164812 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1463/2926] 10.222.0.18 () {58 vars in 967 bytes} [Wed Sep 7 13:14:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:56.177725 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:56.188557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388331b-ad1d-420f-8163-8ade7add7e9c service swift] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:56.194245 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1192aab6e0444db1b006feb37c0fd3fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:56.194876 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:56.195138 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:56.195405 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:56.203333 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:56.205625 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:56.213744 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1464/2927] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Sep 7 13:14:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:14:58.162994 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:58.174782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf1ae-4879-4e60-b76c-75b4fd9f2690 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:58.179944 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:58.180569 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:58.180846 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:58.181115 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] PATH_INFO: `/v3/users/69bf5241bb984cdda7ec49910f7c1fe1` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:58.182232 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bf5241bb984cdda7ec49910f7c1fe1)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:58.184222 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:58.232379 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bf5241bb984cdda7ec49910f7c1fe1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.240849 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bf5241bb984cdda7ec49910f7c1fe1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.241459 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bf5241bb984cdda7ec49910f7c1fe1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.242164 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bf5241bb984cdda7ec49910f7c1fe1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.249263 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bf5241bb984cdda7ec49910f7c1fe1'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.267062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1464/2928] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:14:58 2022] DELETE /identity/v3/users/69bf5241bb984cdda7ec49910f7c1fe1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:14:58.443033 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:58.454837 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792b285-8259-4226-9340-e684ce4122fe service swift] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:58.516425 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:58.517065 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:58.517348 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:58.518218 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] PATH_INFO: `/v3/projects/3fe2cfa0fc504948a31ed2369be6731a` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:58.519865 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe2cfa0fc504948a31ed2369be6731a)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:58.521759 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:58.569217 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe2cfa0fc504948a31ed2369be6731a', 'request_id': 'req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.576142 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe2cfa0fc504948a31ed2369be6731a', 'request_id': 'req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.582231 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe2cfa0fc504948a31ed2369be6731a', 'request_id': 'req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.592957 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] The token cache is being invalidate because project 3fe2cfa0fc504948a31ed2369be6731a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:14:58.593237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.593874 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:14:58.595339 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1465/2929] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:14:58 2022] DELETE /identity/v3/projects/3fe2cfa0fc504948a31ed2369be6731a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:08.263578 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:08.590023 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:16.304820 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:16.306244 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:16.364170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee03e6-b394-478c-a6a6-aa5fd5ea32e3 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:16.412423 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:16.413029 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:16.413304 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:16.413571 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:16.415301 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:16.487558 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:16.488995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c534e1e-d4bd-4a2a-9f98-effcf4e3685e service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:16.500123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1465/2930] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:17.694176 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:17.695692 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:17.707981 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1bcc26-ee64-4601-84dd-d2cbb383f4fe admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:17.711448 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:17.712063 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:17.712336 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:17.712606 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:17.714290 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:17.728358 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:17.729858 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee47c5-3019-4c90-ae18-5e7fdbdab5ed service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:17.742117 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1466/2931] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:26.494987 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=74 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:27.736950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=6 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:30.789294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:30.789294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:30.789294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] PATH_INFO: `/` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:30.789294 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1466/2932] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:16:30.801597 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b100f-2a9c-4530-917b-90dc70fd4f98 None None] REQUEST_METHOD: `POST` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:30.802148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b100f-2a9c-4530-917b-90dc70fd4f98 None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:30.802148 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b100f-2a9c-4530-917b-90dc70fd4f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:30.843157 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.auth.core [None req-2b5b100f-2a9c-4530-917b-90dc70fd4f98 None None] MFA Rules not processed for user `115a83b94378409ea1a6ce3443764cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81487) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:30.844740 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-2b5b100f-2a9c-4530-917b-90dc70fd4f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:30.855611 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1467/2933] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:16:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:16:30.865364 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:30.867168 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:30.881456 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc88d25-2729-47b2-b99c-0f5127a2c492 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:30.885107 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:30.885715 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:30.885995 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:30.886259 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:30.895411 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:30.896909 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ccbe6-eec2-4829-ab59-348df710d777 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:30.905834 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1467/2934] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:31.015670 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f78-e2b7-42c2-ba22-785b837ba47e None None] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:31.016076 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f78-e2b7-42c2-ba22-785b837ba47e None None] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:31.016367 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d563f78-e2b7-42c2-ba22-785b837ba47e None None] PATH_INFO: `/` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:31.018557 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1468/2935] 10.222.0.18 () {54 vars in 921 bytes} [Wed Sep 7 13:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:16:31.024225 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] REQUEST_METHOD: `POST` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:31.024583 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:31.024956 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:31.070194 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.auth.core [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] MFA Rules not processed for user `565774033b5d4aaab833757169efb547`. Rule list: `[]` (Enabled: `True`). {{(pid=81486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:16:31.072316 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:16:31.082025 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1468/2936] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Sep 7 13:16:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:16:31.092456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d563f78-e2b7-42c2-ba22-785b837ba47e None None] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:16:31.104219 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d563f78-e2b7-42c2-ba22-785b837ba47e None None] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:16:31.107800 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:16:31.108383 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:16:31.108660 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:16:31.108928 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:16:31.119456 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:16:31.121037 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:16:31.131638 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1469/2937] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:16:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:16:41.064321 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=15 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:16:41.127017 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=15 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:07.810161 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:07.820587 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd40b11-6d1d-4379-a696-5d0ed7336972 None None] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:07.824170 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '115a83b94378409ea1a6ce3443764cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:07.824766 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:07.825042 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:07.825317 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:07.827016 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:07.837717 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:07.839150 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:07.847565 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1469/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:17.843795 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=6 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:59.598855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:59.598855 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:59.679980 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324f81a-cc60-4336-803d-8e780578267c service neutron] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:59.688316 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:59.689016 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] REQUEST_METHOD: `GET` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:59.689395 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:59.689762 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:59.692205 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:59.704355 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:59.705924 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:59.716896 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1470/2939] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:18:02.589035 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:02.590624 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:02.674096 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e045e82-baf8-4871-85f4-9428fde7ec56 service neutron] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:02.680132 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:02.680782 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:02.681065 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:02.681365 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] PATH_INFO: `/v3/users/4a3f3e6760d74fd4a606645a1b59cef6` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:02.682573 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3f3e6760d74fd4a606645a1b59cef6)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:02.684667 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:02.746157 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3f3e6760d74fd4a606645a1b59cef6'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:02.755529 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3f3e6760d74fd4a606645a1b59cef6'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:02.756166 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3f3e6760d74fd4a606645a1b59cef6'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:02.756886 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3f3e6760d74fd4a606645a1b59cef6'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:02.764704 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3f3e6760d74fd4a606645a1b59cef6'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:02.786933 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1470/2940] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:18:02 2022] DELETE /identity/v3/users/4a3f3e6760d74fd4a606645a1b59cef6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:18:02.984927 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:03.002116 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cf670-c81d-4c57-b273-80a3e01c2719 service placement] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:03.063187 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:03.063866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:03.064197 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:03.064473 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] PATH_INFO: `/v3/projects/9ca2dda4b668401f8389925c7fc8f84b` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:03.065985 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca2dda4b668401f8389925c7fc8f84b)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:03.067947 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:03.115743 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca2dda4b668401f8389925c7fc8f84b', 'request_id': 'req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.123009 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca2dda4b668401f8389925c7fc8f84b', 'request_id': 'req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.128702 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca2dda4b668401f8389925c7fc8f84b', 'request_id': 'req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.140950 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] The token cache is being invalidate because project 9ca2dda4b668401f8389925c7fc8f84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:18:03.141237 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.141986 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.143477 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1471/2941] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:18:02 2022] DELETE /identity/v3/projects/9ca2dda4b668401f8389925c7fc8f84b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:18:03.147563 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:03.148976 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:03.163022 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ade66-612e-4b70-992d-d924aec1ac2d admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:03.220284 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:03.220908 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:03.221185 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:03.221454 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] PATH_INFO: `/v3/users/3287c87986ff4461a237f50f7dbdbb70` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:03.223287 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3287c87986ff4461a237f50f7dbdbb70)` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:03.225328 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:03.247318 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:03.273007 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3287c87986ff4461a237f50f7dbdbb70'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.280438 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3287c87986ff4461a237f50f7dbdbb70'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.281062 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3287c87986ff4461a237f50f7dbdbb70'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.281666 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3287c87986ff4461a237f50f7dbdbb70'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.289419 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.notifications [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3287c87986ff4461a237f50f7dbdbb70'} {{(pid=81486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.307280 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1471/2942] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Sep 7 13:18:03 2022] DELETE /identity/v3/users/3287c87986ff4461a237f50f7dbdbb70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:18:03.491679 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Authenticating user token {{(pid=81487) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:18:03.493120 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.fernet_utils [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81487) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:18:03.507591 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ccc84-a667-47ea-955d-953d2f3fcb4a admin admin] Validating token access rules against request {{(pid=81487) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:18:03.532850 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:03.575866 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c66ed18b954814afb1ba80dd0f24ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6357086c38f94b52a4634cd4a7e2bbea', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81487) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:18:03.576492 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:18:03.576773 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:18:03.577047 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] PATH_INFO: `/v3/projects/1dbc44155fab4b9fbdde47d15d92378d` {{(pid=81487) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:18:03.578172 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbc44155fab4b9fbdde47d15d92378d)` {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:18:03.580107 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] RBAC: Authorization granted {{(pid=81487) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:18:03.627719 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbc44155fab4b9fbdde47d15d92378d', 'request_id': 'req-4313df8d-4a73-4159-ba00-615dd4cadc4c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.636151 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbc44155fab4b9fbdde47d15d92378d', 'request_id': 'req-4313df8d-4a73-4159-ba00-615dd4cadc4c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.641805 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbc44155fab4b9fbdde47d15d92378d', 'request_id': 'req-4313df8d-4a73-4159-ba00-615dd4cadc4c'} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.653302 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] The token cache is being invalidate because project 1dbc44155fab4b9fbdde47d15d92378d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81487) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:18:03.653590 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.654272 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG keystone.notifications [None req-4313df8d-4a73-4159-ba00-615dd4cadc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81487) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:18:03.655778 dv-cinder-856259-1-smb devstack@keystone.service[81487]: [pid: 81487|app: 0|req: 1472/2943] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Sep 7 13:18:03 2022] DELETE /identity/v3/projects/1dbc44155fab4b9fbdde47d15d92378d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:18:13.303869 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:18:13.650382 dv-cinder-856259-1-smb devstack@keystone.service[81487]: DEBUG dbcounter [-] [81487] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:06.090478 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Authenticating user token {{(pid=81486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:06.091906 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:06.160748 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1418f8b-f608-401f-921c-61125881ee12 admin admin] Validating token access rules against request {{(pid=81486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:06.219123 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446b38e21f4a48f29107e4a6deb1ce00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e493059295a84a8785338deeca98abe5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:06.219751 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] REQUEST_METHOD: `GET` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:06.220027 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] SCRIPT_NAME: `/identity` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:06.220290 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:06.222017 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.fernet_utils [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:06.233931 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:06.235534 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592c214-6d07-4314-a5fe-5bc01dcd3a0f service placement] RBAC: Authorization granted {{(pid=81486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:06.245116 dv-cinder-856259-1-smb devstack@keystone.service[81486]: [pid: 81486|app: 0|req: 1472/2944] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:16.240960 dv-cinder-856259-1-smb devstack@keystone.service[81486]: DEBUG dbcounter [-] [81486] Writing DB stats keystone:SELECT=58 {{(pid=81486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}